#serialization #database #content-addressable #break #store #values #stored

casserole

Break and serialize values into content-addressable storage

2 unstable releases

0.2.0 Aug 4, 2021
0.1.0 Jul 20, 2021

#1178 in Encoding

Download history 150/week @ 2024-03-15 73/week @ 2024-03-22 92/week @ 2024-03-29 82/week @ 2024-04-05 51/week @ 2024-04-12 110/week @ 2024-04-19 136/week @ 2024-04-26 102/week @ 2024-05-03 76/week @ 2024-05-10 176/week @ 2024-05-17 76/week @ 2024-05-24 99/week @ 2024-05-31 61/week @ 2024-06-07 40/week @ 2024-06-14 84/week @ 2024-06-21 18/week @ 2024-06-28

222 downloads per month

MIT/Apache

19KB
351 lines

The casserole crate provides a custom derive and a trait to perform break-down serialization and de-serialization of Rust types into stores.

The most common use case is to break down large objects to be stored in content-addressable storage, like in a Git database. Hence the name 'CAS-ser-role'.

The trait which Casserole auto-derives generates smaller types that contain references to keys instead of the original data. For example HashMap<String, BigValue> is replaced with HashMap<String, S::Key> where S is a type parameter to a user-provided storage engine. In addition, fields on which the store attribute is given e.g. #[casserole(store)], are also replaced with S::Key.

For example:

/// Example Tree to be stored in the database
#[derive(Casserole)]
struct Node {
    header: String,

    // Tells that 'map' is replaced by a database key in the type returned from
    // the 'casserole' trait method. The 'decasserole' trait method will do the
    // reverse, restoring it from the database.
    #[casserole(store)]
    map: BTreeMap<String, Node>,
}

Basic usage demonstration (given big_value as a large value to work with):

// Create a our serde-ready type for the root. `stored_root` is our unique
// representation for `big_value`, but it is very small, like a Git hash.
let stored_root = big_value.casserole(&mut store).unwrap();

// <...do other stuff...>

// Restore the origin value from the database
let restored_big_value = Casserole::decasserole(&stored, &mut store).unwrap();
assert_eq!(restored_big_value, big_value);

Dependencies

~1.3–3MB
~56K SLoC