Lib.rs

› Science › Machine learning
#chat-bot #model #llm #rag #api-server #llama #applications

llama-core

The core library of LlamaEdge

by Xin Liu and 11 contributors

40 releases (17 breaking)

new 0.21.2 Nov 6, 2024
0.21.0 Oct 30, 2024
0.13.1 Jul 25, 2024
0.5.0 Mar 25, 2024

#211 in Machine learning

Download history 160/week @ 2024-07-17 234/week @ 2024-07-24 133/week @ 2024-07-31 149/week @ 2024-08-07 9/week @ 2024-08-14 302/week @ 2024-08-21 184/week @ 2024-08-28 32/week @ 2024-09-04 389/week @ 2024-09-11 238/week @ 2024-09-18 977/week @ 2024-09-25 126/week @ 2024-10-02 372/week @ 2024-10-09 47/week @ 2024-10-16 2/week @ 2024-10-23 285/week @ 2024-10-30

709 downloads per month

Apache-2.0

1MB
18K SLoC

LlamaEdge Core

llama-core is part of LlamaEdge API Server project. It defines a set of APIs. Developers can utilize these APIs to build applications based on large models, such as chatbots, RAG, and more.

lib.rs:

Llama Core, abbreviated as llama-core, defines a set of APIs. Developers can utilize these APIs to build applications based on large models, such as chatbots, RAG, and more.

Dependencies

~28–43MB
~534K SLoC