Iris – Can you build an integration pipeline for me?

The promise of Artificial Intelligence technology is flourishing. From Amazon shopping recommendations, Facebook image recognition, and personal assistants like Siri, Cortana, and Alexa,  AI is becoming part of our everyday lives, whether we know it or not. These apps use information collected from your past requests to make predictions and deliver results that are tailored to your preferences. 

The importance of AI in today’s world is not lost upon us at SnapLogic. We are always trying to keep up with the latest innovations and technologies, so making our software fast, efficient, and automated for our customers has always been our goal. With the Spring release, SnapLogic launched the SnapLogic Integration Assistant. The SnapLogic Integration Assistant is a recommendation engine that uses Artificial Intelligence and machine learning to predict the next step in building a data pipeline for the cloud, analytics, and digital initiatives – with up to 90% accuracy.

Currently, customers build pipelines by searching and selecting from over 400 Snaps in the SnapLogic catalog and dragging and dropping them into the canvas. Repeating this step for every single Snap, although easy, can make a pipeline building process somewhat tedious and time-consuming. But with the Integration Assistant, the recommendation engine will provide the logical next steps in the building process, making pipeline building easy and efficient. The recommendation engine is a part of SnapLogic’s “Iris” technology – an industry-first in applying artificial intelligence for enterprise integration. See how it works in this video.

In the next few steps,  learn how to enable this feature and start building interactive pipelines yourself.

Right now, we have two ways of building pipelines:

  • Choose a Snap from the SnapLogic catalog
  • Use the Integration Assistant for recommending the right Snaps

How to enable the Integration Assistant feature

By default, the Integration Assistant option is turned off,  allowing you to continue building pipelines by selecting Snaps in the SnapLogic Catalog. However, to utilize the Integration Assistant, just head to the Settings icon and check the Integration Assistant option.

Once the Integration Assistant is enabled, you’ll immediately see the benefits of the self-guided user interface. Drag the first snap onto the canvas and the Integration Assistant instantly kicks in and highlights the next suitable Snap. At the same time, it also opens up another panel that lists suggested Snaps on the right-hand side of the canvas. These AI-driven Snap recommendations are based on the historical metadata from your previous workflows.

Next, you can choose to click the highlighted Snap or pick from the recommended list by dragging the suitable Snap into the canvas. This process continues further until you select a snap with a closed output. At this point, the Integration Assistant will stop suggesting Snaps and the pipeline will be ready for execution.

As you can see, the Integration Assistant improves your pipeline building experience by suggesting Snaps that are best fit for your organization based on the historical metadata flows.

Interested in learning more? Watch a quick demo on our YouTube channel – SnapLogic Spring 2017: Integration Assistant.”

Namita Prabhu is Senior QA Manager at SnapLogic.

Gaurav Dhillon on the BBC: “Entrepreneurship, Innovation & Passion”

Growing up in India, SnapLogic CEO Gaurav Dhillon was an avid listener of the BBC World Service, the preeminent international radio broadcasting giant based out of London. He wasn’t alone – since 1939, the BBC World Service has ruled the global airwaves, reaching hundreds of millions of people every week with its award-winning 24-hour news, reporting, and analysis.

So it was full-circle for Gaurav, when on a trip to London last week, he was invited by the BBC World Service to appear as a guest on its live global news radio program, ‘Business Matters.‘ Hosted by Roger Hearing, the hour-long show reviews the day’s global headlines and business news, with commentary throughout from live guests – this time including Gaurav and Marketplace reporter Nancy Marshall-Genzer.

After discussing the day’s news, the discussion turned to Gaurav and his storied career in technology. On the table for discussion: Gaurav’s upbringing in India, early influences that shaped his life’s ambitions, how he helped build Informatica from an idea into a billion dollar public company, why his burning desire to innovate and build great products led to his departure from Informatica and to the founding of SnapLogic, and his advice to aspiring entrepreneurs who want to make their mark and have an impact on our world.

You can listen to the full broadcast here. The focused 12-minute discussion with Gaurav starts around the 26:30 mark.

SnapLogic Live: Demos and Q&A with Our Team of Experts

SnapLogic-LiveFor the past few months, we’ve been hosting a series of bi-weekly live demo sessions with our team of integration experts at SnapLogic. Each week we focus on one particular type of integration and, via a live demo, shows how customers can solve different integration challenges using the SnapLogic Elastic Integration Platform. So far, we’ve covered everything from app integration to big data integration for customers using Hadoop.

In addition to the demo, we also take time to cover a Q&A session based on questions we receive from customers and attendees.

If you’re interested in ServiceNow integration, register here for next week’s SnapLogic Live session which will take place on Thursday, October 29th at 10:00am PST / 1:00pm EST. In the meantime, recordings of past sessions are available to view on our video site. One of our most popular SnapLogic Live demos, featuring Salesforce integration, can also be viewed below:

Webinar: It’s the 21st Century – Why Isn’t Your Data Integration Loosely Coupled?

LKDN_IntellyxWebinar_180x110“The problem with traditional connectors is that they are tightly coupled – any change in the data format or interface requirements for either end of any interaction would require an update of the connector, at the risk of a failed interaction.”

– Jason Bloomberg, President, Intellyx

Join us next Tuesday, May 19th for an interactive webinar with digital transformation and SOA thought leader, Jason Bloomberg. In this webinar we’ll hear from Jason about how connectors have been a traditional enterprise application integration (EAI) tool since the dawn of EAI back in the 1990s and how the rise of SOA and Web Services was in part intended to resolve the limitations of such traditional connectors, but often fall short. Additional topics covered will include:

  • A discussion of the age-old problem of implementing loosely coupled data integration
  • An architectural approach to solving this difficult problem
  • A demonstration of SnapLogic’s approach to solving the data integration challenge in a scalable and cloud-friendly manner that aligns with modern application architectures

Before joining the webinar next week, you can also review last week’s Spring 2015 release and learn a little more about Jason Bloomberg here:

Jason Bloomberg is the leading industry analyst and expert on achieving agile digital transformation by architecting business agility in the enterprise. He writes for Forbes, Wired, and his biweekly newsletter, the Cortex. As president of Intellyx, he advises business executives on their digital transformation initiatives, trains architecture teams on Agile Architecture, and helps technology vendors and service providers communicate their agility stories. His latest book is The Agile Architecture Revolution.

A few of our past blog posts also address some of the topics we’ll be diving into next week. Check them out:

Register for the webinar here – we look forward to next week’s interactive discussion.

Getting a Better Return on your Big Data Investment

SNAP_IN_BIG_DATAWhat happens when you’re faced with the challenge of maintaining a legacy data warehouse while dealing with ever-increasing volumes, varieties and velocities of data?

While powerhouses in the days of structured data, legacy data warehouses commonly consisted of RDMS technologies from the likes of Oracle, IBM, Microsoft, and Teradata. Data was extracted, transformed and loaded into data marts or the enterprise data warehouse with traditional ETL tools, built to handle batch-oriented use cases, running on expensive, multi-core servers. In the era of self-service and big data, there’s a rethinking of these technologies and approaches going on in enterprise IT.

In response to these challenges, companies are steadfastly moving to modern data management solutions that consist of NoSQL databases like MongoDB, Hadoop distributions from vendors like Cloudera and Hortonworks, cloud-based systems like Amazon Redshift, and data visualization from Tableau and others. Along this big data and cloud data warehouse journey, many people I speak with have realized that it’s vital to not only modernize their data warehouse implementations, but to future-proof how they collect and drive data into their new analytics infrastructures – requiring an agile, multi-point data integration solution that is both seamless and capable of dealing with structured and unstructured streaming real-time and batch-oriented data. As companies reposition IT and the analytics infrastructure from back-end infrastructure management cost centers to an end-to-end partner of the business, service models become an integral part of both the IT and business roadmaps.

The Flexibility, Power and Agility Required for the New Data Warehouse

In most enterprises today, IT’s focus is moving away from using its valuable resources for undifferentiated-heavy lifting and more into delivering differentiating business value. By using SnapLogic to move big data integration management closer to the edge, resources can be freed up for more value-based projects and tasks while streamlining and accelerating the entire data-to-insights process. SnapLogic’s drag-and-drop data pipeline builder and streaming integration platform removes the burden and complexity of data ingestion into systems like Hadoop, transforming data integration from a rigid, time-consuming process into a process that is more end-user managed and controlled.

Productivity Gains with Faster Data Integration

A faster approach to data integration not only boosts productivity, but in many cases results in substantive cost savings. In one case, a SnapLogic customer with over 200 integration interfaces, managed and supported by a team of 12, was able to reduce their integration management footprint down to less than 2 FTEs, realizing an annual hard cost savings of more than 62% annually, 8:1 annual FTE improvement, infrastructure savings of over 50% and a 35% improvement in their dev-ops release schedule. Ancillary effects with that same customer realized a net productivity gain and increased speed to market by transferring ownership of their Hadoop data ingest process to data scientists and marketers. This shift resulted in the company being more responsive while significantly streamlining their entire data insights process for faster, cheaper and better decision-making across their entire enterprise.

More Agile Company

Increased integration agility means having the ability to make faster, better and cheaper moves and changes. SnapLogic’s modular design allows data scientists and marketers to be light on their feet, making adds, moves and changes in a snap with the assurance they require as new ideas arise and new flavors of data sources enter the picture.

By integrating with Hadoop through the SnapLogic Enterprise Integration Platform, with fast, modern and multi-point data integration, customers have the ability to seamlessly connect to and stream data from virtually any endpoint, whether cloud-based, ground-based, legacy, structured or unstructured. In addition, by simplifying the data integration, SnapLogic customers no longer need to use valuable IT resources to manage and maintain data pipelines, freeing them to contribute to areas of more business value.

Randy Hamilton is a Silicon Valley entrepreneur and technologist who writes periodically about industry related topics including the cloud, big data and IoT.  Randy has held positions as Instructor (Open Distributed Systems) at UC Santa Cruz and has enjoyed positions at Basho (Riak NoSQL database), Sun Microsystems, and Outlook Ventures, as well as being one of the founding members and VP Engineering at Match.com.

Next Steps:

SnapLogic an Enterprise iPaaS Visionary

SnapLogic iPaaSWith Gartner’s 2nd Enterprise Integration Platform as a Service (iPaaS) report published last week, Loraine Lawson at ITBusinessEdge has referred to the iPaaS market as a “Volatile Boom Town.” At SnapLogic, we’re proud to announce that we have once again been recognized as a Visionary Leader in this high-growth market. Here’s what our founder and CEO, Gaurav Dhillon, had to say about the report:

“Since launching the SnapLogic Elastic Integration Platform in late 2013 our product development team has been laser-focused on adding new functionality that solves the challenges of integrating today’s hybrid environments with on-premise, cloud and big data applications. We believe our visionary position is a reflection of growing enterprise customer adoption an continued innovation in delivering a unified platform that addresses both application and big data integration use cases simultaneously.”

Gaurav also talked about how SnapLogic’s cloud integration bet paid off in this diginomica featured interview last week.

At SnapLogic, we’ve set up to address the Integrator’s Dilemma, by pushing for the convergence of application and data integration in the modern era. It’s time to rethink legacy ESB and ETL in the enterprise. Here are some of the companies highlights in the last 12 months. Thanks to all of our customers and partners for their continued support.

Company Execution:

Platform Innovations

  • 300+ Snaps: pre-built connectors, called Snaps, to the most popular cloud and big data systems are now available, including Box, Cloudera, Concur, Eloqua, Hortonworks, NetSuite, MongoDB, Salesforce, SAP, ServiceNow and Workday
  • Snap Patterns: reusable process and data integration patterns make it easy to configure and address the most common integration use cases and data flows for connecting cloud services like Amazon Redshift from Amazon Web Services
  • SnapReduce 2.0: translates data flow pipelines into MapReduce code, enabling customers to ingest, prepare and deliver big data to power next generation analytics
  • Hadooplex: SnapLogic’s hybrid execution grid can run in the cloud, on-premise or as a native YARN application in a Hadoop cluster
  • Ultra Pipelines: dramatically speeds the process by which time-sensitive data is delivered to cloud and big data applications

Partnership Momentum

  • Cloudera and Hortonworks certifications: the Hadooplex introduced to run as a Hadoop 2.0 YARN application
  • SAP Netweaver certification: enables customers to easily share data between their SAP software and other enterprise and cloud applications. SAP Hana Snaps also introduced
  • Integration with Okta: provides seamless, secure access to the SnapLogic platform and a single point of control for user authentication and authorization through the Okta Application Networks
  • AWS Redshift Free Trial and Snap Patterns: quickly build, deploy and efficiently manage multiple high-volume, data-intensive integration tasks delivering data to and from a cloud data warehouse
  • Salesforce Analytics Cloud Snaps and Patterns: powering the Wave with easy data loading and transformation

As you can see it was a busy year for the SnapLogic team…and we’re just getting started! This week we’ll be at Gartner BI in Las Vegas and on April 9th, we’ll be at the AWS Summit in San Francisco. You can check out all of our upcoming events here and be sure to Contact Us if you’d like more information on the SnapLogic Elastic Integration Platform.

Talking “SMACT” With CIOs

SMACTWe recently reviewed the many fall tech events happening in the Bay Area and elsewhere and just got back from a few CIO-specific conferences last week. There have been a wide range of topics covered during recent events, including the next wave of cloud computing, cloud analytics, integration platform as a service (iPaaS), big data and big data integration.

Last week in Miami Beach we were at the Technology Business Management (TBM) Conference, which brought together Global 2000 CIOs, CTOs and CFOs to hear from peers and learn about new solutions on the market that can help modernize and transform enterprise IT organizations. While at the TBM Conference we had the opportunity to speak with CIOs and other IT leaders about how SnapLogic customers have reduced the complexity of their integrations by up to 85% and connected data, applications and APIs at least 4x faster. We also discussed common use cases for our platform such as cloud and on-premises application integration, digital marketing, big data analytics, self-service for “citizen integrators,” and the establishment of an agile enterprise integration layer or fabric.

old vs. newAt the Midmarket CIO Forum in Tucson, also last week, we met with CIOs from a variety of industries and reviewed the new data, application and API integration challenges that are facing today’s IT leaders. We discussed the “Integrator’s Dilemma” and how older, more traditional ETL tools and approaches to integration aren’t built for the new data challenges. Lastly, we talked about how to avoid getting “SMACT” summed up by the following:

  • Don’t settle for SO SO (same old, same old)
  • The first step to solving the Integrator’s Dilemma is recognizing it exists!
  • When it comes to Social, Mobile, Analytics, Cloud computing and the Internet of Things  wait to integrate!

You can find our presentation slides here. Also be sure to check out some of the social buzz below from TBM Conference and the Midmarket CIO Forum, as well as our infographic here on why CIOs are getting “SMACT”: