7 releases
new 0.1.9 | Apr 10, 2025 |
---|---|
0.1.8 | Apr 9, 2025 |
#523 in Text processing
442 downloads per month
13KB
222 lines
hat-splitter
The hat-splitter
crate implements the HAT splitting rule. If you don't know
what that is, you probably won't find this crate useful.
Installation
cargo add hat-splitter
Usage
use hat_splitter::{HATSplitter, Splitter};
let my_hat_splitter = HATSplitter::new();
let split_text: Vec<String> = my_hat_splitter.split("Hello, world!");
assert_eq!(split_text, vec!["Hello,", " world!"]);
let split_text: Vec<Vec<u8>> = my_hat_splitter.split_with_limit("Hello, world!", 4);
assert_eq!(split_text, vec![b"Hell".to_vec(), b"o,".to_vec(), b" wor".to_vec(), b"ld!".to_vec()]);
Dependencies
~2.4–3.5MB
~58K SLoC