7 releases

new 0.1.9 Apr 10, 2025
0.1.8 Apr 9, 2025

#523 in Text processing

Download history 431/week @ 2025-04-03

442 downloads per month

Custom license

13KB
222 lines

hat-splitter

The hat-splitter crate implements the HAT splitting rule. If you don't know what that is, you probably won't find this crate useful.

Installation

cargo add hat-splitter

Usage

use hat_splitter::{HATSplitter, Splitter};

let my_hat_splitter = HATSplitter::new();
let split_text: Vec<String> = my_hat_splitter.split("Hello, world!");
assert_eq!(split_text, vec!["Hello,", " world!"]);

let split_text: Vec<Vec<u8>> = my_hat_splitter.split_with_limit("Hello, world!", 4);
assert_eq!(split_text, vec![b"Hell".to_vec(), b"o,".to_vec(), b" wor".to_vec(), b"ld!".to_vec()]);

Dependencies

~2.4–3.5MB
~58K SLoC