arXiv Computation and Language
3d ago

Marking Contour Tones in Yor\`{u}b\'{a}

arXiv:2609.38627v1 Announce Type: new Abstract: Yor\`ub\'a is a tonal language in which contour tones pose persistent orthographic challenges. These are especially notable for personal names and lexi...

By K\'ol\'a T\'ub\`os\'un
arXiv Computation and Language
Sep 22

Type-Driven Tokenization for Brahmic Scripts

arXiv:2609.22125v1 Announce Type: new Abstract: Standard tokenizers used in large language models produce malformed text when applied to Brahmic scripts. They are a family of abugidas, writing system...

By Sai Hemanth Kapila, Rakshika Bagavathy