#machine-learning #grpc-api #deep-learning #mlops

jams-serve

jams-serve provides a http and gRPC API for jams-core

32 releases

0.1.31 Nov 5, 2024
0.1.30 Oct 27, 2024
0.1.20 Jun 21, 2024

#5 in #mlops

Download history 94/week @ 2024-07-27 14/week @ 2024-09-14 47/week @ 2024-09-21 261/week @ 2024-10-12 753/week @ 2024-10-19 475/week @ 2024-10-26 170/week @ 2024-11-02 15/week @ 2024-11-09

1,465 downloads per month
Used in jams

Apache-2.0

1MB
4.5K SLoC

JAMS-SERVE

This library crate is part of a wider project called J.A.M.S - Just Another Model Server. Please refer here.

jams-serve is a http and gRPC API library for jams-core.

Refer here for the OpenAPI Spec

  • /healthcheck: Endpoint for health checks

  • /api/predict: Endpoint for making predictions

  • /api/models: Endpoint for managing models

Refer here for the proto definition

  • HealthCheck
  • Predict
  • GetModels
  • AddModel
  • UpdateModel
  • DeleteModel

Stable on Linux x86_64 architecture

Dependencies

~92MB
~1.5M SLoC