18 releases

Uses new Rust 2024

new 0.6.3 Apr 17, 2025
0.5.12 Apr 4, 2025
0.5.11 Mar 27, 2025
0.5.10 Nov 22, 2024
0.4.1 Dec 20, 2023

#1038 in Text processing

Download history 11/week @ 2025-02-08 12/week @ 2025-02-15 100/week @ 2025-03-22 101/week @ 2025-03-29 291/week @ 2025-04-05 220/week @ 2025-04-12

712 downloads per month

MIT license

495KB
10K SLoC

Custom text tokenizer

Dependencies

~1MB
~18K SLoC