Lib.rs

›
#llama #cpp #sampler #bindings #low #api #cuda

sys llama-cpp-sys-4

Low Level Bindings to llama.cpp

Owned by Eugene Hauptmann.

4 releases

new 0.1.86 Nov 23, 2024
0.1.85 Nov 8, 2024
0.1.84 Nov 5, 2024
0.1.83 Oct 27, 2024

#12 in #sampler

Download history 21/week @ 2024-10-21 118/week @ 2024-10-28 251/week @ 2024-11-04 15/week @ 2024-11-11

405 downloads per month
Used in llama-cpp-4

MIT/Apache

6MB
121K SLoC

C++ 67K SLoC // 0.1% comments C 33K SLoC // 0.1% comments CUDA 8K SLoC // 0.0% comments Metal Shading Language 4.5K SLoC // 0.1% comments Objective-C 3.5K SLoC // 0.0% comments Python 3.5K SLoC // 0.1% comments Rust 455 SLoC // 0.3% comments

llama-cpp-sys

Raw bindings to llama.cpp with cuda support, including new Sampler API from llama-cpp.

See llama-cpp-4 for a safe API.

lib.rs:

See llama-cpp-4 for a documented and safe API.

Dependencies