2 releases
new 0.3.1 | Apr 17, 2025 |
---|---|
0.3.0 | Apr 8, 2025 |
#32 in #alphabet
188 downloads per month
Used in 3 crates
(via alphabet_detector)
16KB
338 lines
Alphabet Detector
Detects 387 alphabets in 170 scripts
one spoken language can be written in multiple scripts, so it will be detected as a different alphabet/language
look at the alphabet.rs to understand what languages have already defined alphabets. Some of them need validation
Separates words in text (from iterator CharIndices
), and detects language of words by used alphabets (chars).
Warning: can return words with chars from the Unicode private area (for example Lingala
, Nuer
or Yoruba
languages)
Dependencies
~1–1.6MB
~27K SLoC