We are excited to announce product enhancements from the October and November releases of the SnapLogic Intelligent Integration Platform. With latest updates, organizations can accelerate time-to-market by building data pipelines and process automations faster. With AutoPrep enhancements, you can format data in different ways or mask sensitive data easily, without writing code. With AutoSync updates, you can load data to Google BigQuery and foster collaboration between team members. Platform has been enhanced with a new mapper sorting functionality, HashiCorp enhancements, and a few security enhancements. We have also enhanced a number of Snap Packs such as Amazon S3, Marketo, AlloyDB, Microsoft Exchange Online, Snowflake, just to name a few. You can also build APIs quickly by easily moving assets and policies, and there are many more updates for you to explore.
Do you want to know how these updates can help you finish projects faster? Please continue on!
Faster Code-free Data Preparation
AutoPrep continues to evolve and add significant value to business users and integration specialists alike. You can use AutoPrep instead of a Mapper in any pipeline to transform data as it travels from one application or data endpoint to another. With new AutoPrep enhancements, you can easily format data without writing any code. Given how ubiquitous data transformations are, we estimate that it can save your team of 5 over $1.8M a year.
You can format dates, country codes (in alpha-2, alpha-2, full name), currency, or phone numbers. Enhancements also allow you split fields into multiple columns or rename fields.
Data engineers might also encounter sensitive data such as social security numbers, salary numbers, email addresses and so on. This sensitive data can be easily masked with MD5, SHA1, SHA256, SHA512 algorithms using AutoPrep with a single click.
To learn more about AutoPrep enhancements, please check out this demo video.
Seamless Cloud Data Ingestion With AutoSync Updates
SnapLogic AutoSync is a key part of SnapLogic’s Cloud Data Orchestration initiative that aims to orchestrate all of customer data across cloud and on-premises endpoints. With AutoSync, we want to make it easy for customers to connect to enterprise systems, manage data movement, build robust integrations and provide high levels of observability.
With recent updates to SnapLogic AutoSync, we have added support for Google BigQuery as a target endpoint. We have also added a collaboration functionality that allows IT teams to share endpoint accounts such as those for Snowflake, Salesforce, Oracle etc. with business users. As a result, business users don’t have to deal with the complicated task of configuring endpoint accounts and can just focus on loading data to the cloud data warehouse. Teams can also share endpoint accounts between projects or with other teams.
To see AutoSync updates in action, please check out this video.
Platform Enhancements
With October and November platform releases, the platform now provides more security and privacy features.
Customers who are using HashiCorp Vault with SnapLogic as their secrets repository can restrict the use of Vault to specific Project Spaces. Often different Project Spaces are used by different departments within an organization and hence with this feature, secrets from a project space can be kept private within a department.
A second security enhancement adds recommended OWASP security headers such as Strict-Transport-Security, X-XSS-Protection, X-Frame-Options etc. to responses from Groundplex nodes. These security headers are critical to protect against Clickjacking, Cookiejacking, etc. that a malicious entity can use.
Thirdly, we have also upgraded the base image of our pre-built SnapLogic Groundplex image from CentOS to AlmaLinux. CentOS 7 support will end in 2024 so many organizations have started making this change.
To complement these security features, we have added the following key enhancements to improve user productivity when building and managing integrations.
First feature allows you to easily create a feature branch into your GitHub repository right from within SnapLogic. This feature allows you and your team members to simultaneously work on a data pipeline in their respective feature branches and then merge their changes later.
A new Mapper sorting feature, allows you to sort the schema by incoming index instead of alphabetically, allowing you to easily access fields/columns with lower indices which are often the most frequently used ones.
Projects now inherit permissions of the Project Space with just one click eliminating the need to explicitly specify permissions. We anticipate that even this small feature will deliver massive value for you when maintaining integrations.
To get a close look at these updates, please check out this video.
Snap Pack Enhancements
October and November releases add a number of Snap Pack enhancements. These enhancements help you quickly build data pipelines and automated business processes with more pre-built connectors and comprehensive functionality.
Amazon S3 Snap Pack has been enhanced with three new Snaps to improve ease of use.
- Select Snap allows you to query CSV/JSON/Parquet objects directly. It also supports cases where objects are compressed with GZIP or BZIP2 format. If the input data format is in CSV, users can specify the input CSV format configuration, i.e. Field Delimiter, Record Delimiter, etc. And when an input data is in JSON format, standard JSON as well as JSON Lines are supported.
- Archive Snap allows you to easily change the storage class of objects in S3. The Snap supports following storage classes: Standard, GlacierInstantRetrieval, GlacierFlexibleRetrieval, DeepArchive, IntelligentTiering, StandardInfrequentAccess, OneZoneInfrequentAccess, so you can pick the right storage class to optimize for speed and costs.
- Restore Snap restores archived objects in S3. The Snap initiates the restore job for archived S3 objects.
Marketo Snap Pack adds two new Snaps Bulk Import and Bulk Export to simplify movement of bulk data in and out of Marketo:
- Bulk Import and Bulk Export Snaps support Activities, Program Members, Custom objects, and Leads in addition to prior support for Bulk Import of Leads.
AlloyDB Snap Pack gives out-of-the-box connectivity to hosted PostgreSQL database in Google Cloud.
Exchange Online Snap now provides full email functionality with capabilities such as:
- Support for HTML tables when sending emails
- Support for in-line attachments along with regular attachments.
- Ability to read/move email from/to folders or subfolders
Azure Synapse Bulk Load Snap now handles complex queries such as COPY INTO allowing you to save time with pre-built connectors when doing complex data operations.
Snowflake Snap Pack now supports improved error reporting with full error view and aggregate view for Bulk Load Snap so that you can get more relevant information quickly when troubleshooting or doing maintenance.
To get a complete list of Snap updates, please visit our documentation here.
Ease of API Development
Last but not the least are the API Management enhancements. We continue to make it easy for API developers and admins to create and publish APIs. You can now automate mundane tasks with simple clicks and build and manage APIs faster.
- You can easily move API assets such as files, pipelines from one version to another during API creation.
- You can easily import and export policies from one API version to another helping you apply a consistent set of policies across your API portfolio.
- You can get more flexibility for hosting your APIs by changing the Snaplex while publishing APIs to the Developer Portal.
The November 2022 release introduces a number of new features and Snaps, so try them out in the product and let us know your feedback! If you missed the November 2022 product release webinar, you can watch it here and hear from our product team. You can always learn more about these updates by visiting the SnapLogic Documentation.
If you are not yet part of the SnapLogic Community, join the conversation here. Engage with others and get your questions answered, and for upcoming product releases check out the ‘Product Updates’ section in the community to get your first glimpse into what is coming next.
