rust_tokenizers is used at run time in 28 crates (of which 7 optionally). It is a direct run-time dependency in 10 crates. It's used only as a dev dependency in 1 crate.

Number of dependers rust_tokenizers version Downloads/month
20 8.1.1 6.1K
7 7.0.2 2.0K
1 5.0.1 0
1 3.1.6 290
Depender (with downloads and own rev deps) rust_tokenizers version
4.6K 19 rust-bert ^8.1.1
sbert ^7.0
automated ^8.1.0
sentinellm_ai ^8.1.1
rust_hero ~7.0.1
stablediffusion-wgpu ^8.1.0
380 pocket-cli optional ^8.1.0
220 llm-llama optional ^3.1.2
2 divvunspell optional ^7
semchunk-rs optional ^8.1.1
2 luminal dev ^8.1.0