87 releases

0.1.102 Feb 25, 2025
0.1.91 Jan 30, 2025
0.1.85 Dec 5, 2024
0.1.84 Nov 27, 2024
0.1.45 Mar 27, 2024

#880 in Machine learning

Download history 477/week @ 2024-11-27 1224/week @ 2024-12-04 742/week @ 2024-12-11 237/week @ 2024-12-18 187/week @ 2024-12-25 536/week @ 2025-01-01 268/week @ 2025-01-08 456/week @ 2025-01-15 666/week @ 2025-01-22 738/week @ 2025-01-29 437/week @ 2025-02-05 802/week @ 2025-02-12 913/week @ 2025-02-19 677/week @ 2025-02-26 762/week @ 2025-03-05 2000/week @ 2025-03-12

4,463 downloads per month
Used in 6 crates (via llama-cpp-2)

MIT/Apache

6MB
118K SLoC

C++ 59K SLoC // 0.1% comments C 30K SLoC // 0.1% comments CUDA 9K SLoC // 0.0% comments GLSL 5.5K SLoC // 0.0% comments Metal Shading Language 5K SLoC // 0.0% comments Objective-C 4K SLoC // 0.0% comments Python 4K SLoC // 0.1% comments Rust 409 SLoC // 0.1% comments

llama-cpp-sys

Raw bindings to llama.cpp with cuda support.

See llama-cpp-2 for a safe API.


lib.rs:

See llama-cpp-2 for a documented and safe API.

Dependencies