3 releases
0.0.3 | Jul 1, 2023 |
---|---|
0.0.2 | Jun 23, 2023 |
0.0.1 | Jun 16, 2023 |
#19 in #tokenization
22 downloads per month
Used in 3 crates
(2 directly)
240KB
4K
SLoC
any-lexer
Warning: This library is experimental and may change drastically in 0.0.*
versions.
any-lexer is a collection of lexer implementations, capable of tokenizing various programming languages, markup languages, and various other formats.
The currently implemented lexers include Rust, C, Python, CSS, SCSS, JSON, JSON with Comments, and many more.