Lib.rs

›
#data-fusion #spark #behavior #arrow

datafusion-comet-spark-expr

DataFusion expressions that emulate Apache Spark's behavior

by Andy Grove, Andrew Lamb, Liang-Chi Hsieh and 58 contributors

7 releases (breaking)

0.7.0 Mar 17, 2025
0.6.0 Feb 17, 2025
0.5.0 Jan 17, 2025
0.4.0 Nov 18, 2024
0.1.0 Jul 23, 2024

#2 in #spark

Download history 3/week @ 2024-12-07 52/week @ 2025-01-11 63/week @ 2025-01-18 8/week @ 2025-02-01 2/week @ 2025-02-08 110/week @ 2025-02-15 14/week @ 2025-02-22 6/week @ 2025-03-01 109/week @ 2025-03-15 15/week @ 2025-03-22

130 downloads per month

Apache-2.0

495KB
11K SLoC

datafusion-comet-spark-expr: Spark-compatible Expressions

This crate provides Apache Spark-compatible expressions for use with DataFusion and is maintained as part of the Apache DataFusion Comet subproject.

Dependencies

~72MB
~1.5M SLoC