arXiv Computation and Language

pylazaro: a Python package for anglicism extraction in Spanish

pylazaro is an open‑source Python package that automatically extracts unassimilated lexical borrowings—primarily anglicisms—from Spanish text. It provides a unified interface to five sequence‑labeling models trained with different libraries, allowing users to switch models without handling library idiosyncrasies. The package outperforms general‑purpose large language models (F1 <0.40) with its best model achieving an F1 of 0.86, and has been downloaded over 58,000 times, powering the Observatorio Lazaro resource that tracks anglicism usage in Spanish media.

arXiv AI
Jun 17

findsylls: A Language-Agnostic Toolkit for Syllable-Level Speech Tokenization and Embedding

arXiv:2603. 26292v2 Announce Type: replace-cross Abstract: Syllable-level units offer compact and linguistically meaningful representations for spoken language modeling and unsupervised word discovery, but research on syllabification remains fragmented across disparate implementations, datasets, and evaluation protocols.

By H\'ector Javier V\'azquez Mart\'inez
arXiv Computation and Language
Sep 3

MUDIDI: A Two-Stage Framework for Multilingual Dictionary Digitization with Language Models

MUDIDI is a two-stage framework designed to digitize multilingual dictionaries that are currently only available as scanned images. The first stage assesses character recognition and markup preservation, while the second stage segments dictionary entries and maps them into the SIL Multi-Dictionary Formatter schema. The authors also release a dataset of 30 annotated dictionaries and benchmark OCR, LLM, and VLM systems, finding that LLMs generally outperform others and that providing additional context improves digitization quality.

By David Setiawan, Temuulen Khishigsuren, Milind Agarwal, Pagnarith Pit, Aso Mahmudi, Ekaterina Vylomova
arXiv Computation and Language
2d ago

Text Generation in Low-Resource Languages Using Human-Curated Vocabularies

The paper presents a framework that combines human-curated vocabularies with a few human-written exemplars to enable large language models (LLMs) to generate coherent text in extremely low-resource or unseen languages. By sampling candidate words from a Zipfian distribution and providing syntactic signals, the method achieves fluent sentence-level generation and promising paragraph-level results across languages with varying resource levels. The study evaluates output quality using lexical diversity, off-target ratio, and human fluency judgments, demonstrating that reasoning-enabled LLMs can effectively bootstrap synthetic data even when digital resources are scarce.

By Michael Christlambert Sinanta (Independent Researcher), Muhammad Dehan Al Kautsar (Mohamed bin Zayed University of Artificial Intelligence), Amanda Nurul Izzah (Independent Researcher), Thanh-Nhi Nguyen (Independent Researcher), Phan Phuong Mai Chau (Mohamed bin Zayed University of Artificial Intelligence), Zheng Wei Lim (University of Amsterdam), Fajri Koto (Mohamed bin Zayed University of Artificial Intelligence)
arXiv Computation and Language
Sep 15

Beyond Surface Forms: A Comprehensive, Mechanism-Oriented Taxonomy of Indirect Linguistic Encoding for LLM-Based Coded Language Detection

arXiv:2606.27314v2 Announce Type: replace Abstract: To avoid moderation and surveillance on social media, some users routinely invent indirect linguistic expressions (ILE) that camouflage sensitive m...

By Hamid Reza Firoozfar, Mohammadsadegh Abolhasani, Reza Mousavi, Paul Jen-Hwa Hu
arXiv AI
Oct 16

Chronoberg: A 250-Year Diachronic Corpus with Temporal Affective Lexicons for Language Model Analysis

Chronoberg is a 250‑year English book corpus from Project Gutenberg, enriched with temporal annotations and affective lexicons (Valence‑Arousal‑Dominance). It allows researchers to track lexical semantic change over time and to evaluate how large language models handle sentiment and discriminatory language across different historical periods. The authors demonstrate that current LLMs struggle with diachronic shifts, underscoring the need for temporally aware training and evaluation pipelines.

By Niharika Hegde, Subarnaduti Paul, Lars-Joel Frey, Manuel Brack, Kristian Kersting, Martin Mundt, Patrick Schramowski
arXiv Computation and Language
Sep 1

SinLlama -- A Large Language Model for Sinhala

The paper introduces SinLlama, the first decoder‑based open‑source large language model with explicit support for Sinhala. By extending Llama‑3‑8B, adding Sinhala‑specific tokenizer vocabulary, and performing continual pre‑training on a cleaned 10‑million‑token Sinhala corpus, the authors created a model that surpasses both the base and instruction‑fine‑tuned variants of Llama‑3‑8B on three text classification tasks. This work addresses the underrepresentation of low‑resource languages in open‑source LLMs.

By H. W. K. Aravinda, Rashad Sirajudeen, Samith Karunathilake, Nisansa de Silva, Surangika Ranathunga, Rishemjit Kaur