arXiv Computation and Language
Wiktionary as a Crowdsourced Lexicon for English Dialects
Read the original on arXiv Computation and Language →The Flow has not summarised this story yet — read it at arXiv Computation and Language.
Related stories
arXiv AI
Aug 7
MameLoshnLM: Yiddish Language Model and Evaluation Benchmark
arXiv:2608. 05850v1 Announce Type: cross Abstract: We present MameLoshnLM, the first open-source 8B-parameter language model built specifically for Yiddish.
Hugging Face Trending Papers
Aug 6
MameLoshnLM: Yiddish Language Model and Evaluation Benchmark
We present MameLoshnLM, the first open-source 8B-parameter language model built specifically for Yiddish. Despite Yiddish's rich textual tradition, its limited digital presence and the scarcity of reliable evaluation resources have constrained progress in Yiddish language modeling.
arXiv AI
Jul 24
slang.gr as a Large-Scale Crowdsourced Resource for Non-Standard Greek
arXiv:2607. 21255v1 Announce Type: cross Abstract: Slang is a central component of everyday language, reflecting linguistic creativity, social identity, and cultural change, yet its dy- namic and non-standard nature makes it difficult to model computationally.
arXiv Computation and Language
Sep 22
Large Language Models for Low-Resource Languages: A Conceptual Framework for an Electronic Explanatory Dictionary of the Tajik Language
arXiv:2608.04186v3 Announce Type: replace Abstract: This paper presents a conceptual framework for developing an electronic explanatory dictionary of the Tajik language using large language models (L...
arXiv Computation and Language
2d ago
Towards Automated Lexicography: Generating and Evaluating Definitions for Learner's Dictionaries
The paper tackles the problem of automatically generating dictionary definitions for learner’s dictionaries, focusing on simplicity and clarity. It introduces a new evaluation framework that uses large language models as judges, validated against human annotators with comparable agreement levels. The authors also present an iterative simplification approach that produces definitions scoring highly on their criteria and exhibiting lexical simplicity.
arXiv Computation and Language
Sep 22
Revisiting Lexicon Evaluation in Unsupervised Word Discovery
The paper critiques the normalized edit distance metric used for evaluating lexicons derived from unsupervised word discovery, noting its bias toward large clusters and its failure to account for the distribution of true classes across clusters. It proposes two new metrics—one that weights cluster size when measuring within‑cluster consistency and another that evaluates how true words are spread across clusters—drawing on clustering theory. Experiments on synthetic and real‑world lexicons show that these combined metrics better correlate with ground‑truth distributions and are more robust to evaluation biases.