The Flow has not summarised this story yet — read it at Hugging Face Trending Papers.
The paper introduces the Language-Aware Skeleton Exploration Framework (LASEF) to investigate how the language of skeleton prompts affects multilingual mathematical reasoning in large language models. Experiments across various math benchmarks, model sizes, and languages show that English skeletons provide a modest advantage on average, especially for smaller models and low-resource languages, but this advantage is not universal and often not statistically significant after correction. The study identifies three distinct patterns of skeleton-language effects—directionally consistent, evaluation- and benchmark-dependent, and asymmetric negative—highlighting that skeleton language is a context-dependent design choice that requires comprehensive exploration.
arXiv:2607. 06327v1 Announce Type: cross Abstract: Uncertainty estimation (UE) enables LLM-powered systems to recognize when to abstain, yet existing research has predominantly focused on English.
arXiv:2607. 05992v1 Announce Type: cross Abstract: Mathematical reasoning has become a central task for evaluating and tuning reasoning Large Language Models (LLMs), yet existing benchmarks remain heavily biased toward high-resource languages, with English and Chinese dominating both pre-training corpora and evaluation suites.
The study investigates the performance gap between native-language reasoning and English-pivoted reasoning in large language models. By creating extensive multilingual reasoning datasets and fine‑tuning specialists on Qwen/Qwen3-8B-Base, the authors find that the native reasoning gap is much smaller (1.9–3.5%) than previously reported. They analyze weight‑space changes, discover a language‑agnostic reasoning core in the middle layers, and propose a Layer Swap technique that transfers these mid‑layer updates from an English specialist to native specialists, effectively closing most of the gap while maintaining native chain‑of‑thought output.
The study explores how the language used for reasoning affects retrieval‑augmented generation (RAG) in a monolingual German setting. Using a German RAG question‑answering testbed based on the tabletop game The Dark Eye, the authors show that aligning the reasoning language with the query and retrieved documents improves performance, with German reasoning outperforming French reasoning. However, German reasoning still does not surpass the model’s native English reasoning, indicating that native multilingual reasoning is necessary for optimal results.
The paper investigates how mathematical reasoning improvements from Reinforcement Post-Training (RPT) in English-centric large language models (LLMs) transfer to other languages. Experiments show that transfer varies greatly depending on the initial model, target language, and training approach, and that stronger English initialization does not guarantee better transfer efficiency. Adding a single parallel language to the training data yields the largest boost, with additional languages providing smaller but consistent gains.