Lib.rs

›
#proxy #inference #optimization #compliant #open-api #llm #performance

app runesmith

OpenAPI compliant optimizing inference proxy for enhancing accuracy and performance of LLMs

Owned by da-moon.

1 unstable release

0.1.0 Sep 13, 2024

#29 in #compliant

Download history 105/week @ 2024-09-07 62/week @ 2024-09-14 15/week @ 2024-09-21 23/week @ 2024-09-28 1/week @ 2024-10-05

206 downloads per month

AGPL-3.0-or-later

13KB

runesmith-rs

RuneSmith: OpenAPI compliant optimizing LLM inference proxy

No runtime deps