#proxy #llm #logging #observability

yanked chronicle-local

The Chronicle LLM proxy API, built for local use with SQLite and configuration files

1 unstable release

0.1.1 May 9, 2024

#72 in #observability

Apache-2.0

385KB
9K SLoC

chronicle

Chronicle is a proxy for language model API calls which

  • Provides retries and optionally falls back to other providers on a failed call
  • Records each call in a database, and sends OpenTelemetry events
  • Lets you switch model provider APIs without changing your request format.
  • Comes with a drop-in fetch function that will redirect OpenAI SDK calls to Chronicle instead.
  • Comes in two versions:
    • A full-fledged server for production use that uses PostgreSQL
    • A lightweight server that logs to an SQLite database and can read configuration from disk.

See the roadmap for the current status and other notes.

Dependencies

~85MB
~1.5M SLoC