Fall is the time to move your clocks back, get a pumpkin latte and slow down with the approaching cold weather. But not for SnapLogic! We continue to deliver system integration solutions with full force. After our Summer 2016 release, which was feature-packed, the Fall 2016 release takes the SnapLogic platform to a whole new level by extending support for Teradata, introducing new Snap Packs for Snowflake and Azure Data Lake Store, adding more capabilities to Spark mode, and delivering several enhancements for security, performance and governance. As our VP of engineering, Vaikom Krishnan, aptly said, “We continue to make it easier and faster for organizations to connect any and all data sources – whether on premises, in the cloud, or in hybrid environments.”
SnapLogic announced the availability of new pre-built intelligent connectors – called Snaps – for Microsoft Azure Data Lake Store. The new Snaps provide fast, self-service data ingestion and transformation from virtually any source – whether on-premises, in the cloud or in hybrid environments – to Microsoft’s highly-scalable, cloud-based repository for big data analytics workloads. This latest integration between SnapLogic and Microsoft Azure helps enterprise customers gain new insights and unlock business value from their cloud-based big data initiatives.
Microsoft Azure HDInsight is an Apache Hadoop distribution powered by the cloud. Internally HDInsight leverages the Hortonworks data platform. HDInsight supports a large set of Apache big data projects like Spark, Hive, HBase, Storm, Tez, Sqoop, Oozie and many more. The suite of HDInsight projects can be administered via Apache Ambari.
This post lists out the steps involved in spinning up an HDInsight cluster, setting up SnapLogic’s Hadooplex on HDInsight, and building and executing a Spark data flow pipeline on HDInsight. We start with spinning up a HDInsight cluster from the MS Azure Portal. Continue reading “Executing Spark Pipelines on HDInsight”
Take a look at our new video outlining SnapLogic’s various points of integration with Microsoft and the Azure and Cortana ecosystems. This is the latest in a series of announcements and go-to-market activities we’ve done over the last nine months regarding our work with Microsoft, including our initial partnership announcement.
Produced in conjunction with Microsoft, this brief video features SnapLogic’s VP of Product Management, Craig Stewart. In it, Craig discusses how SnapLogic’s hybrid architecture is a natural fit for consuming and moving large data sets between on premises sources and the cloud, making it the ideal integration solution for Microsoft Azure data stores, HDInsight and Cortana Intelligence solutions.
The video also explores SnapLogic’s many Snaps for Microsoft solutions including Azure SQL Data Warehouse, Azure SQL Database, Azure Active Directory, Azure SQL Bulk Load and Blob Storage, plus on-premises Microsoft SQL Server, Dynamics, Active Directory and more.
Stay tuned for more additions to our library of solutions for Microsoft Azure, HDInsight, and Cortana customers.
SnapLogic continues to build on its momentum in cloud-based data management with new support for HDInsight, Microsoft’s big-data-as-a-service on Azure. This follows our other recent announcements regarding support for the Microsoft Azure and Cortana ecosystem including availability in the Azure Marketplace. Continue reading “New With the Spring 2016 Release: Data Ingest-Prep-Deliver for Microsoft HDInsight”