Lib.rs

› Science › Machine learning
#chat-bot #model #llm #rag #api-server #llama #applications

llama-core

The core library of LlamaEdge

by Xin Liu and 13 contributors

62 releases (23 breaking)

0.27.1 Feb 11, 2025
0.26.7 Feb 10, 2025
0.25.2 Dec 18, 2024
0.23.3 Nov 29, 2024
0.5.0 Mar 25, 2024

#191 in Machine learning

Download history 281/week @ 2024-10-29 316/week @ 2024-11-05 90/week @ 2024-11-12 304/week @ 2024-11-19 413/week @ 2024-11-26 250/week @ 2024-12-03 649/week @ 2024-12-10 199/week @ 2024-12-17 26/week @ 2024-12-24 64/week @ 2024-12-31 368/week @ 2025-01-07 59/week @ 2025-01-14 156/week @ 2025-01-21 153/week @ 2025-01-28 622/week @ 2025-02-04 399/week @ 2025-02-11

1,334 downloads per month

Apache-2.0

1MB
20K SLoC

LlamaEdge Core

llama-core is part of LlamaEdge API Server project. It defines a set of APIs. Developers can utilize these APIs to build applications based on large models, such as chatbots, RAG, and more.

lib.rs:

Llama Core, abbreviated as llama-core, defines a set of APIs. Developers can utilize these APIs to build applications based on large models, such as chatbots, RAG, and more.

Dependencies

~27–41MB
~512K SLoC