65 releases (24 breaking)

new 0.28.2 Mar 13, 2025
0.28.0 Feb 25, 2025
0.25.2 Dec 18, 2024
0.23.3 Nov 29, 2024
0.5.0 Mar 25, 2024

#217 in Machine learning

Download history 354/week @ 2024-11-20 364/week @ 2024-11-27 425/week @ 2024-12-04 474/week @ 2024-12-11 195/week @ 2024-12-18 26/week @ 2024-12-25 100/week @ 2025-01-01 362/week @ 2025-01-08 32/week @ 2025-01-15 155/week @ 2025-01-22 160/week @ 2025-01-29 815/week @ 2025-02-05 270/week @ 2025-02-12 92/week @ 2025-02-19 125/week @ 2025-02-26 175/week @ 2025-03-05

864 downloads per month

Apache-2.0

1MB
20K SLoC

LlamaEdge Core

llama-core is part of LlamaEdge API Server project. It defines a set of APIs. Developers can utilize these APIs to build applications based on large models, such as chatbots, RAG, and more.


lib.rs:

Llama Core, abbreviated as llama-core, defines a set of APIs. Developers can utilize these APIs to build applications based on large models, such as chatbots, RAG, and more.

Dependencies

~27–42MB
~521K SLoC