12 releases

0.1.94 Feb 11, 2025
0.1.93 Feb 2, 2025
0.1.92 Jan 21, 2025
0.1.90 Dec 30, 2024
0.1.83 Oct 27, 2024

#363 in Graphics APIs

Download history 256/week @ 2024-11-23 20/week @ 2024-11-30 132/week @ 2024-12-07 67/week @ 2024-12-14 115/week @ 2024-12-21 153/week @ 2024-12-28 151/week @ 2025-01-04 57/week @ 2025-01-11 110/week @ 2025-01-18 6/week @ 2025-01-25 137/week @ 2025-02-01 122/week @ 2025-02-08 38/week @ 2025-02-15 3/week @ 2025-02-22 4/week @ 2025-03-01

72 downloads per month
Used in llama-cpp-4

MIT/Apache

7MB
134K SLoC

C++ 81K SLoC // 0.1% comments C 30K SLoC // 0.1% comments CUDA 9K SLoC // 0.0% comments Metal Shading Language 5K SLoC // 0.0% comments Objective-C 4K SLoC // 0.0% comments Python 4K SLoC // 0.1% comments Rust 501 SLoC // 0.3% comments

llama-cpp-sys

Raw bindings to llama.cpp with cuda support, including new Sampler API from llama-cpp.

See llama-cpp-4 for a safe API.

OpenMPI support

brew install open-mpi
cargo build -F mpi

lib.rs:

See llama-cpp-4 for a documented and safe API.

Dependencies