wiktionary-part-of-speech-extract

./sample.xml is just the head of the entire wikimedia enwiktionary-20210320-pages-articles.xml download (source).

The purpose of this generator is to parse the file in its entirety.

cargo run ./sample.xml

lib.rs:

cargo run regenerate --release enwiktionary-pages-*.xml # regenerate "words.fst" binary
cargo publish # publish lib including "words.fst" binary

Usage

use wiktionary_part_of_speech_extract::{ENGLISH_TAG_LOOKUP, TagSet, Tag};

assert_eq!(Some(TagSet::of(&[Tag::Noun, Tag::Verb])), ENGLISH_TAG_LOOKUP.get("harbor"));