#tokenizers #rule-based #containing

paltoquet

A library of rule-based general-purpose tokenizers

22 releases (10 breaking)

0.11.0 Nov 18, 2024
0.10.0 Sep 26, 2024
0.4.0 Jul 30, 2024

#502 in Text processing

Download history 10/week @ 2024-10-25 22/week @ 2024-11-01 113/week @ 2024-11-08 203/week @ 2024-11-15 44/week @ 2024-11-22 34/week @ 2024-11-29 54/week @ 2024-12-06 33/week @ 2024-12-13 2/week @ 2024-12-20 6/week @ 2025-01-03 20/week @ 2025-01-10 25/week @ 2025-01-17 86/week @ 2025-01-24 27/week @ 2025-01-31 39/week @ 2025-02-07

182 downloads per month
Used in xan

MIT license

94KB
3K SLoC

Paltoquet

WIP...

Dependencies

~6MB
~141K SLoC