arXiv Computation and Language By Lucas Bandarkar, Alan Ansell, Trevor Cohn

Large Reasoning Models Struggle to Transfer Parametric Knowledge Across Scripts

Read the original on arXiv Computation and Language →

The paper investigates why large reasoning language models struggle to transfer parametric knowledge across different scripts. Through observational data and regression analysis on ECLeKTic and MultiLoKo datasets, the authors find that script mismatch—not language family—is the main predictor of transfer failure when controlling for model capability and question difficulty. By providing key entities in the source language and training models to reason about transliteration ambiguities, they demonstrate a reduction in the cross‑script transfer gap, suggesting that post‑training improvements can enhance cross‑lingual knowledge transfer.

Machine-generated by The Flow from the publisher's headline and feed description — not written or checked by a human. The full article lives at arXiv Computation and Language.

arXiv Computation and Language
Aug 27

Rethinking the Multilingual Reasoning Gap with Layer Swap

The study investigates the performance gap between native-language reasoning and English-pivoted reasoning in large language models. By creating extensive multilingual reasoning datasets and fine‑tuning specialists on Qwen/Qwen3-8B-Base, the authors find that the native reasoning gap is much smaller (1.9–3.5%) than previously reported. They analyze weight‑space changes, discover a language‑agnostic reasoning core in the middle layers, and propose a Layer Swap technique that transfers these mid‑layer updates from an English specialist to native specialists, effectively closing most of the gap while maintaining native chain‑of‑thought output.

By Maxence Lasbordes, Am\'elie Chatelain, Djam\'e Seddah
Hugging Face Trending Papers
Jun 25

Multilingual Reasoning Cascades Need More Context

Translation cascades for reasoning translate the query from another language to English, reason in English, and translate the answer back to the original language. This is a competitive approach to multilingual reasoning, but structurally lossy, since each stage discards information later stages may need, including cues for cultural grounding, register, and disambiguation.