#tokenizers #rule-based #containing

paltoquet

A library of rule-based general-purpose tokenizers

22 releases (10 breaking)

0.11.0 Nov 18, 2024
0.10.0 Sep 26, 2024
0.4.0 Jul 30, 2024

#509 in Text processing

Download history 194/week @ 2024-11-16 42/week @ 2024-11-23 30/week @ 2024-11-30 53/week @ 2024-12-07 33/week @ 2024-12-14 1/week @ 2024-12-21 10/week @ 2025-01-04 21/week @ 2025-01-11 61/week @ 2025-01-18 47/week @ 2025-01-25 26/week @ 2025-02-01 67/week @ 2025-02-08 90/week @ 2025-02-15 47/week @ 2025-02-22 67/week @ 2025-03-01

272 downloads per month
Used in xan

MIT license

94KB
3K SLoC

Paltoquet

WIP...

Dependencies

~6MB
~141K SLoC