Lib.rs

Cargo Features

delta_kernel has no features set by default.

[dependencies]
delta_kernel = { version = "0.8.0", features = ["arrow", "arrow_53", "arrow_54", "need_arrow", "arrow-conversion", "arrow-expression", "cloud", "default-engine-base", "default-engine", "default-engine-rustls", "developer-visibility", "sync-engine", "integration-test"] }

arrow = arrow_53

The default version to be expected

arrow_53 arrow?

Enables arrow ^53

Arrow supported versions
53
Used in default engine

and parquet ^53

Used in default and sync engine

arrow_54

Enables arrow and parquet

arrow:

54

need_arrow arrow-conversion? arrow-expression? default-engine-base? sync-engine?

arrow-conversion default-engine-base? = need_arrow

Affects delta_kernel::engine…

arrow-expression default-engine-base? = need_arrow

Affects engine::arrow_expression…

cloud = hdfs-native-object-store

Enables aws, azure, gcp and http of object_store >=0.11, <0.12

Affects storage::parse_url_opts_hdfs_native…

default-engine-base default-engine? default-engine-rustls? = arrow-conversion, arrow-expression, futures, need_arrow, object_store, tokio

this is an 'internal' feature flag which has all the shared bits from default-engine and default-engine-rustls

Enables fast-rng and v4 of uuid

Affects engine::default, engine::arrow_data, engine::parquet_row_group_skipping, engine::arrow_expression…

default-engine = default-engine-base

the default-engine use the reqwest crate with default features which uses native-tls. if you want to instead use rustls, use 'default-engine-rustls' which has no native-tls dependency

Enables reqwest

Used for fetching direct urls (like pre-signed urls)

Affects delta_kernel::engine…

default-engine-rustls = default-engine-base

Enables http2 and rustls-tls-native-roots of reqwest

developer-visibility

Affects actions::visitors, delta_kernel::path, delta_kernel::log_segment…

sync-engine = need_arrow, tempfile

Affects engine::sync, engine::arrow_data, engine::parquet_row_group_skipping, engine::arrow_expression, delta_kernel::engine…

integration-test = hdfs-native, walkdir

Enables integration-test of hdfs-native-object-store ^0.12.0

Features from optional dependencies

In crates that don't use the dep: syntax, optional dependencies automatically become Cargo features. These features may have been created by mistake, and this functionality may be removed in the future.

tempfile sync-engine?

Enables tempfile

Used in the sync engine

futures default-engine-base?

object_store cloud? default-engine-base?

Enables object_store >=0.11, <0.12

hdfs-native-object-store cloud? integration-test?

Enables hdfs-native-object-store ^0.12.0

reqwest default-engine? default-engine-rustls?

tokio default-engine-base?

Enables tokio

optionally used with default engine (though not required)

hdfs-native integration-test?

Enables hdfs-native ^0.10.0

Used in integration tests

walkdir integration-test?