39 releases (23 stable)
new 2.0.0-rc.9 | Nov 21, 2024 |
---|---|
2.0.0-rc.6 | Sep 10, 2024 |
2.0.0-rc.4 | Jul 7, 2024 |
2.0.0-rc.1 | Mar 28, 2024 |
1.13.1 | Nov 27, 2022 |
#2 in Machine learning
80,676 downloads per month
Used in 61 crates
(41 directly)
640KB
13K
SLoC
ort
is an (unofficial) ONNX Runtime 1.20 wrapper for Rust based on the now inactive onnxruntime-rs
. ONNX Runtime accelerates ML inference and training on both CPU & GPU.
π Documentation
π€ Support
π Projects using ort
Open a PR to add your project here π
- Twitter uses
ort
to serve homepage recommendations to hundreds of millions of users. - Bloop uses
ort
to power their semantic code search feature. - edge-transformers uses
ort
for accelerated transformer model inference at the edge. - Ortex uses
ort
for safe ONNX Runtime bindings in Elixir. - Supabase uses
ort
to remove cold starts for their edge functions. - Lantern uses
ort
to provide embedding model inference inside Postgres. - Magika uses
ort
for content type detection. sbv2-api
is a fast implementation of Style-BERT-VITS2 text-to-speech usingort
.
π Sponsor ort
Dependencies
~2β11MB
~130K SLoC