#charset #unicode #text-encoding #encoding

textcode

Text encoding/decoding library. Supports: UTF-8, ISO6937, ISO8859, GB2312

6 releases

0.2.2 May 2, 2022
0.2.1 Nov 3, 2020
0.1.2 Apr 24, 2020
0.1.1 Dec 23, 2019
0.1.0 Nov 18, 2019

#390 in Text processing

Download history 301/week @ 2024-08-01 336/week @ 2024-08-08 556/week @ 2024-08-15 221/week @ 2024-08-22 388/week @ 2024-08-29 384/week @ 2024-09-05 303/week @ 2024-09-12 201/week @ 2024-09-19 346/week @ 2024-09-26 297/week @ 2024-10-03 229/week @ 2024-10-10 161/week @ 2024-10-17 220/week @ 2024-10-24 284/week @ 2024-10-31 230/week @ 2024-11-07 74/week @ 2024-11-14

850 downloads per month
Used in 7 crates (4 directly)

MIT license

445KB
7.5K SLoC

textcode

docs

Intro

textcode is a library for text encoding/decoding. Supports next charsets:

  • UTF-8
  • iso-6937 - Latin superset of ISO/IEC 6937 with Euro and letters with diacritics
  • iso-8859-1 - Western European
  • iso-8859-2 - Central European
  • iso-8859-3 - South European
  • iso-8859-4 - North European
  • iso-8859-5 - Cyrillic
  • iso-8859-6 - Arabic
  • iso-8859-7 - Greek
  • iso-8859-8 - Hebrew
  • iso-8859-9 - Turkish
  • iso-8859-10 - Nordic
  • iso-8859-11 - Thai
  • iso-8859-13 - Baltic Rim
  • iso-8859-14 - Celtic
  • iso-8859-15 - Western European
  • iso-8859-16 - South-Eastern European
  • gb2312 - Simplified Chinese

Example:

use textcode::iso8859_5;

const UTF8: &str = "Привет!";
const ISO8859_5: &[u8] = &[0xbf, 0xe0, 0xd8, 0xd2, 0xd5, 0xe2, 0x21];

let mut dst: Vec<u8> = Vec::new();
iso8859_5::encode(UTF8, &mut dst);
assert_eq!(dst.as_slice(), ISO8859_5);

let mut dst = String::new();
iso8859_5::decode(ISO8859_5, &mut dst);
assert_eq!(UTF8, dst.as_str());

No runtime deps