Lib.rs

› Text editors
#llm #daemon #language-server #run #running #script #python

llm-daemon

LLM as a daemon

by Jeong, Heon

32 releases

0.5.9 Feb 23, 2025
0.4.0 Dec 15, 2024
0.3.14 Sep 6, 2024
0.3.13 Jul 12, 2024

#156 in Text editors

Download history 10/week @ 2024-12-04 122/week @ 2024-12-11 20/week @ 2024-12-18 178/week @ 2025-01-22 181/week @ 2025-01-29 20/week @ 2025-02-05 62/week @ 2025-02-12 116/week @ 2025-02-19 29/week @ 2025-02-26

239 downloads per month

GPL-3.0-only

10MB
206K SLoC

C++ 115K SLoC // 0.1% comments C 31K SLoC // 0.1% comments Python 19K SLoC // 0.1% comments CUDA 9K SLoC // 0.0% comments GLSL 6.5K SLoC // 0.0% comments Metal Shading Language 5K SLoC // 0.0% comments OpenCL 4.5K SLoC Objective-C 4K SLoC // 0.0% comments JavaScript 2.5K SLoC // 0.2% comments TSX 2K SLoC // 0.0% comments Shell 2K SLoC // 0.1% comments Rust 1.5K SLoC // 0.0% comments Swift 1K SLoC // 0.0% comments Kotlin 702 SLoC // 0.1% comments Vim Script 670 SLoC // 0.1% comments TypeScript 586 SLoC // 0.1% comments RPM Specfile 108 SLoC // 0.2% comments Batch 77 SLoC // 0.2% comments Prolog 35 SLoC INI 10 SLoC

llm-daemon

Daemon to run llm server. Can be useful when you need a LLM server but don't want to run it on your own.

  • Language Server which requires LLM
  • Python script which requires LLM while it's running

Dependencies

~13–26MB
~410K SLoC