arXiv Computation and Language By Sirui Chen

How Much Does Corpus Choice Change Dependency-Distance Estimates?

Read the original on arXiv Computation and Language →

The study examined how the choice of corpus affects estimates of dependency distance in language. By comparing 38 pairs of treebanks from the same language, the authors found that cross-treebank agreement was only moderate, with nearly 40% of language orderings reversed when switching treebanks. Treebank selection explained about 29% of the variance, a discrepancy that far exceeds within-treebank sampling error and persists across multiple preprocessing settings, yet all treebanks still supported the principle of dependency-length minimization.

Machine-generated by The Flow from the publisher's headline and feed description — not written or checked by a human. The full article lives at arXiv Computation and Language.

arXiv Computation and Language
Oct 12

BLiMPPI: Benchmark of Linguistic Minimal Pairs for Polarity Items

BLiMPPI is a multilingual benchmark comprising over 12,000 minimal pairs for negative polarity items (NPIs) across 33 languages. It is constructed by extracting NPIs from Universal Dependencies treebanks, labeling their licensing contexts, and generating minimal pair perturbations. The study evaluates 12 multilingual and 2 monolingual language models, revealing that multilingual models perform poorly on low‑resource languages and on pairs that cannot be solved by simple n‑gram patterns, while also exploring how NPI typology, language family, licensing variability, and NPI‑licenser distance affect performance.

By Arzu Burcu G\"uven, Anna Rogers, Leonie Weissweiler, Joakim Nivre, Rob van der Goot
arXiv AI
Jun 12

AfriSUD: A Dependency Treebank Collection for Evaluating Models on African Languages

arXiv:2606. 12708v1 Announce Type: cross Abstract: Despite their linguistic diversity and global significance, African languages remain underrepresented in research and resources to support NLP.

By Happy Buzaaba, Cheikh Mouhamadou Bamba Dione, David Ifeoluwa Adelani, Sylvain Kahane, Kim Gerdes, Bruno Guillaume, Kevin Guan, Aremu Anuoluwapo, Naome A. Etori, Shamsuddeen Hassan Muhammad, Utitofon Inyang, Peter Nabende, David Sabiiti Bamutura, Andiswa Bukula, Chinedu Uchechukwu, Rooweither Mabuya, Idris Akinade, Christiane Fellbaum
arXiv Computation and Language
Oct 22

A Parallel Multi-Dialect Arabic Dependency Treebank

The paper introduces MADARTB, the first large-scale parallel Arabic dependency treebank covering five city dialects—Beirut, Cairo, Doha, Rabat, and Tunis—alongside Modern Standard Arabic. It contains 5,000 sentences annotated with the CATiB dependency scheme and shows that while overall construction profiles are similar across varieties, local syntactic structures often diverge, indicating significant structural variation. A supervised parser achieves 87.5% LAS, outperforming the best LLM setup at 85.7% LAS across all six varieties, and the authors release the annotations and models publicly.

By Noor Abo Mokh, Mohamed Adel, Jamila El-Gizuli, Go Inoue, Ahmed Elshabrawy, Nizar Habash