Natural language processing

Classical and neural NLP: translation, question answering, tokenization and the evaluation of language understanding.

2,601 stories · RSS feed

arXiv AI
Sep 1

AdaFuse: Adaptive Ensemble Decoding with Test-Time Scaling for LLMs

AdaFuse is an adaptive ensemble decoding framework for large language models that dynamically selects fusion units during generation. It uses an uncertainty-based criterion to decide when to ensemble, applying a diversity-aware scaling strategy in uncertain states while continuing direct generation when confident. Experiments on question answering, arithmetic reasoning, and machine translation show AdaFuse outperforms strong baselines with an average relative improvement of 6.88%.

By Chengming Cui, Tianxin Wei, Ziyi Chen, Ruizhong Qiu, Zhichen Zeng, Zhining Liu, Xuying Ning, Duo Zhou, Jingrui He
arXiv AI
Sep 1

When LLMs Benchmark Themselves: Deconstructing Self-Bias in Automated Evaluation

The paper investigates the issue of self‑bias when large language models (LLMs) generate and evaluate their own benchmarks. Using machine translation as a testbed, it shows that LLMs as both test‑set creators and evaluators produce model‑specific, homogeneous outputs that inflate their own scores, even when diversity controls are applied. The bias is strong enough that each model ranks itself first, overriding peer consensus, and the phenomenon also appears in open‑ended generation tasks.

By Wenda Xu, Sweta Agrawal, Vil\'em Zouhar, Markus Freitag, Daniel Deutsch
arXiv AI
Sep 1

AtlasNLP: A Country-Aware Atlas of Dataset Representation in NLP

arXiv:2608.30107v1 Announce Type: cross Abstract: Understanding which countries are represented in NLP datasets is essential for identifying gaps, targeting data collection, measuring progress, and i...

By Joan Nwatu, Tsedeniya Solomon Amare, Longju Bai, Bontu Fufa Balcha, Zayd Bashir, Angana Borah, Zara Burzo, Yubin Choi, Naihao Deng, Samika Gupta, Michel Faloughi, Claude Kwizera, Ziqiao Ma, Cynthia Yacel Fuertes Panizo, Ellie Seehorn, Hui Shen, Jiayi Tang, Zesen Zhao, Boyuan Zheng, Rada Mihalcea