#machine-learning #grpc-api #deep-learning #mlops

jams-serve

jams-serve provides a http and gRPC API for jams-core

32 releases

new 0.1.31 Nov 5, 2024
0.1.30 Oct 27, 2024
0.1.20 Jun 21, 2024

#4 in #mlops

Download history 94/week @ 2024-07-29 15/week @ 2024-09-16 46/week @ 2024-09-23 599/week @ 2024-10-14 791/week @ 2024-10-21 117/week @ 2024-10-28

1,507 downloads per month
Used in jams

Apache-2.0

1MB
4.5K SLoC

JAMS-SERVE

This library crate is part of a wider project called J.A.M.S - Just Another Model Server. Please refer here.

jams-serve is a http and gRPC API library for jams-core.

Refer here for the OpenAPI Spec

  • /healthcheck: Endpoint for health checks

  • /api/predict: Endpoint for making predictions

  • /api/models: Endpoint for managing models

Refer here for the proto definition

  • HealthCheck
  • Predict
  • GetModels
  • AddModel
  • UpdateModel
  • DeleteModel

Stable on Linux x86_64 architecture

Dependencies

~93MB
~1.5M SLoC