#llama-cpp #llama #llama-cpp-sys

sys llama-cpp-sys-2

Low Level Bindings to llama.cpp

87 releases

0.1.102 Feb 25, 2025
0.1.91 Jan 30, 2025
0.1.85 Dec 5, 2024
0.1.84 Nov 27, 2024
0.1.45 Mar 27, 2024

#1139 in Machine learning

Download history 230/week @ 2024-12-27 519/week @ 2025-01-03 363/week @ 2025-01-10 609/week @ 2025-01-17 633/week @ 2025-01-24 576/week @ 2025-01-31 419/week @ 2025-02-07 840/week @ 2025-02-14 1006/week @ 2025-02-21 668/week @ 2025-02-28 1125/week @ 2025-03-07 2288/week @ 2025-03-14 1570/week @ 2025-03-21 1656/week @ 2025-03-28 1711/week @ 2025-04-04 1791/week @ 2025-04-11

7,029 downloads per month
Used in 6 crates (via llama-cpp-2)

MIT/Apache

6MB
118K SLoC

C++ 59K SLoC // 0.1% comments C 30K SLoC // 0.1% comments CUDA 9K SLoC // 0.0% comments GLSL 5.5K SLoC // 0.0% comments Metal Shading Language 5K SLoC // 0.0% comments Objective-C 4K SLoC // 0.0% comments Python 4K SLoC // 0.1% comments Rust 409 SLoC // 0.1% comments

llama-cpp-sys

Raw bindings to llama.cpp with cuda support.

See llama-cpp-2 for a safe API.

Dependencies