Connecting Big Data and the IoT in a Snap
In 2014, Ovum’s Saurabh Sharma, who recently published the Integration Platform as a Service (iPaaS) Decision Matrix, wrote about the lack of Internet of Things (IoT) standards and how this is hindering adoption. This week Loraine Lawson at ITBusinessEdge wrote about the intersection of big data and IoT, pointing to new Forrester and Dimensional Research reports that highlight the challenges of managing unstructured data in the enterprise.
The Spring 2015 release of the SnapLogic Elastic Integration Platform extends our cloud application and big data integration capabilities to IoT with support for Message Queuing Telemetry Transport (MQTT). This means SnapLogic customers can easily build dataflow pipelines that connect to an MQTT broker for sensors, mobile and connected devices and stream data to analytical and other applications in real time. One of the primary use cases for the new MQTT Snaps is rapidly integrating IoT data with other big data sources and enterprise applications for predictive, advanced analytics and data visualization.
Given the nature of our JSON-centric iPaaS, it’s important to note that MQTT is just the first of a set of standards and protocols we’re looking at supporting as more and more customers seek to harness and manage IoT data as part of an overall data lake strategy. Later this year, the SnapLogic iPaaS will support additional IoT protocols such as AMQP, CoAP, OMA, Lightweight M2M and ETSI Smart M2M.
In this demonstration, you can see the new MQTT Snaps in action. The demonstration highlights the platform’s ability to:
- Ingest real-time device messages in real time
- Validate, transform and route messages
- Integrate message data with application or API data
- Persist messages on Hadoop, Amazon Redshift, Google BigQuery and others
- Provide bidirectional communication with devices
- Provide seamless cross-protocol support as we continue to introduce support for new protocols and standards
At SnapLogic, we’re focused on ensuring our customers can go beyond legacy ETL and ESB technologies and connect faster – whether you’re integrating big data, cloud applications or the Internet of Things. We look forward to your feedback on the new MQTT Snaps and what hearing you’d like to see next when it comes to the intersection of big data and IoT.