1 unstable release
0.0.2 | Jul 16, 2023 |
---|
#658 in Memory management
33KB
722 lines
Utility classes to integrate the (Object Store)https://crates.io/crates/object_store in an application. This started initially as an effort in (Polars)https://pola.rs
BRAINSTORM
Since the Polars implementation relies heavily on (mmap)https://crates.io/crates/memmap2 our API will be inspired from that crate.
- Use the mmap interface for the advise operation.
- Change the polars code to issue
advise()
before access. - Implement the advise on top of
object_store
in the current crate.
DELIVERY PHASES
- download
- cache
- validated the cache
- sparse downloads
Dependencies
~11–22MB
~325K SLoC