The Hadoop Zip File Reader and Writer Snaps allow for secure creation of and access to zip files on Kerberized HDFS instances. The Hadoop Zip File Reader Snap enables lets you create and write Zip files directly into the Hadoop file system. Use this Snap to collect files from various locations, zip all the files together and upload the zip file into their Hadoop file system. The Hadoop File Writer reads content from zip files that are located in the Hadoop file system, matches specific criteria, and make the unzipped files available to downstream Snaps.
- Hadoop Zip File Reader
- Hadoop Zip File Writer
In this pipeline example, the HDFS Zip File Writer and Reader are used to aggregate multiple files in a zip file and upload it into a Hadoop File System.
Learn more about how Snaps work with the SnapLogic Enterprise Integration Cloud here.