Lib.rs

› Science › Machine learning › lance-encoding
#file-format #apache-arrow #codec #data-encoding #machine-learning #data-science #data-analytics

lance-encoding-datafusion

Encoders and decoders for the Lance file format that rely on datafusion

by Weston Pace, Will Jones, Chang She, Lei Xu and 64 contributors

17 releases (8 breaking)

0.19.2 Nov 13, 2024
0.18.2 Oct 4, 2024
0.15.0 Jul 25, 2024

#1010 in Machine learning

Download history 9/week @ 2024-07-29 217/week @ 2024-08-05 14/week @ 2024-08-12 132/week @ 2024-09-02 169/week @ 2024-09-16 30/week @ 2024-09-23 312/week @ 2024-09-30 27/week @ 2024-10-07 19/week @ 2024-10-14 214/week @ 2024-10-21 4/week @ 2024-11-04 117/week @ 2024-11-11

336 downloads per month

Apache-2.0

2MB
41K SLoC

lance-encoding-datafusion

lance-encoding-datafusion is an internal sub-crate, containing encoders and decoders for the Lance file format that rely on Datafusion. Partly this is to keep the size of lance-encoding small and partly this is to prove that encodings are extensible.

Important Note: This crate is not intended for external usage.

Dependencies

~80MB
~1.5M SLoC