#table #metadata #iceberg #specification #apache #sorting #apache-arrow

iceberg-rust-spec

Unofficial implementation of the Iceberg table format specification

17 releases (6 breaking)

new 0.7.0 Feb 19, 2025
0.6.1 Dec 10, 2024
0.5.8 Oct 18, 2024
0.5.1 Jul 12, 2024
0.1.0 Nov 22, 2023

#698 in Parser implementations


Used in 14 crates (3 directly)

Apache-2.0

350KB
7.5K SLoC

Apache Iceberg specification implementation in Rust

This crate provides the core data structures and implementations for working with Apache Iceberg tables in Rust. It includes:

  • Complete implementation of the Apache Iceberg table format specification
  • Type-safe representations of schemas, partitioning, sorting and other metadata
  • Serialization/deserialization of all Iceberg metadata formats
  • Arrow integration for reading and writing Iceberg data
  • Utility functions for working with Iceberg tables

The crate is organized into several modules:

  • spec: Core specification types and implementations
  • arrow: Integration with Apache Arrow
  • error: Error types and handling
  • util: Common utility functions

Dependencies

~11–18MB
~242K SLoC