Lib.rs

› Rendering › Graphics APIs
#llama #cpp-bindings #cuda #low-level #api

sys babichjacob-llama-cpp-sys-2

Low Level Bindings to llama.cpp

Owned by babichjacob.

4 releases

0.1.85 Dec 5, 2024
0.1.82 Oct 8, 2024
0.1.81 Oct 8, 2024
0.1.80 Oct 8, 2024

#909 in Graphics APIs

Download history 223/week @ 2024-10-02 192/week @ 2024-10-09 18/week @ 2024-10-16 12/week @ 2024-10-30 15/week @ 2024-11-06 181/week @ 2024-12-04 43/week @ 2024-12-11 7/week @ 2024-12-18 4/week @ 2024-12-25 6/week @ 2025-01-01

77 downloads per month
Used in babichjacob-llama-cpp-2

MIT/Apache

5.5MB
107K SLoC

C++ 50K SLoC // 0.1% comments C 34K SLoC // 0.1% comments CUDA 8K SLoC // 0.0% comments Metal Shading Language 5K SLoC // 0.0% comments Objective-C 4K SLoC // 0.0% comments Python 3.5K SLoC // 0.1% comments GLSL 3K SLoC // 0.0% comments Rust 284 SLoC // 0.1% comments

llama-cpp-sys

Raw bindings to llama.cpp with cuda support.

See llama-cpp-2 for a safe API.

lib.rs:

See llama-cpp-2 for a documented and safe API.

Dependencies