#ggml #gguf #llama-cpp

ggml-quants

GGml defined quantized data types and their quant/dequant algorithm

1 unstable release

0.0.0 Nov 25, 2024

#6 in #gguf

Download history 122/week @ 2024-11-20 49/week @ 2024-11-27 27/week @ 2024-12-04 12/week @ 2024-12-11 16/week @ 2024-12-18 27/week @ 2024-12-25 8/week @ 2025-01-08

53 downloads per month
Used in 2 crates (via ggus)

MIT license

32KB
1K SLoC

ggml-quants

CI Latest version Documentation license

ggml-quants is a Rust library that implements the quantized data types defined by ggml and their corresponding quantization and dequantization algorithms.

Dependencies

~1.5MB
~31K SLoC