The Open Table Iceberg Snap Pack brings native Apache Iceberg connectivity to SnapLogic pipelines. It connects to an Iceberg REST catalog (such as Polaris) backed by S3-compatible object storage, letting pipelines read and write Iceberg-managed tables using Spark SQL without leaving the platform or writing custom code. The pack supports core lakehouse capabilities such as time travel queries, automatic table creation with schema inference, multiple storage formats, and Iceberg partition transforms. It is aimed at teams building modern data lakehouse pipelines on top of Apache Iceberg (Iceberg 1.6.1, Spark 3.5.7).
What you can do
With this Snap Pack, you can run filtered/sorted SELECT queries against Iceberg tables (including historical snapshots via time travel), insert data into new or existing Iceberg tables with automatic schema inference and partitioning, and execute arbitrary Spark SQL DDL/DML statements (CREATE, ALTER, DROP, MERGE, DELETE) directly against the Iceberg catalog.
Why it matters
Open table formats like Iceberg are becoming the backbone of modern data lakehouse architectures, but integrating them into ETL/ELT pipelines typically requires custom Spark code or separate tooling. This Snap Pack gives SnapLogic customers pipeline-native, low-code access to Iceberg-managed data lakes, reducing engineering overhead for lakehouse initiatives.
This Snap Pack includes the following key features
- Time travel — query historical table versions by Snapshot ID or Timestamp
- Auto table creation with schema inference from upstream documents
- Flexible storage formats: Parquet, ORC, Avro with configurable compression codecs (snappy, gzip, zstd, lz4)
- Partition strategies using Iceberg transforms: identity, year, month, day, hour, bucket
- Schema propagation between Select and Insert Snaps via secondary metadata views
This Snap Pack contains the following Snaps
- Open Table Iceberg – Select — Executes SQL SELECT statements against an Iceberg catalog, with filtering, sorting, pagination, and time-travel support for historical snapshots.
- Open Table Iceberg – Insert — Inserts upstream document data into Iceberg tables, with auto table creation, multiple storage formats, and partitioning.
- Open Table Iceberg – Execute — Executes arbitrary Spark SQL DDL/DML statements (CREATE/ALTER/DROP/INSERT/MERGE/DELETE) against the Iceberg catalog.
To learn more
To learn more, please check out the documentation page.
