13 releases

Uses new Rust 2024

new 0.5.11 Mar 27, 2025
0.5.10 Nov 22, 2024
0.5.6 Sep 6, 2024
0.5.3 Aug 7, 2024
0.4.1 Dec 20, 2023

#1023 in Text processing

Download history 29/week @ 2024-11-29 15/week @ 2024-12-06 2/week @ 2024-12-13 23/week @ 2025-02-14

645 downloads per month

MIT license

490KB
10K SLoC

Custom text tokenizer

Dependencies

~1MB
~18K SLoC