SmolLM3: smol, multilingual, long-context reasoner

Learning to reason with LLMs

Multilingual Reasoning Cascades Need More Context

Translation cascades for reasoning translate the query from another language to English, reason in English, and translate the answer back to the original language. This is a competitive approach to multilingual reasoning, but structurally lossy, since each stage discards information later stages may need, including cues for cultural grounding, register, and disambiguation.

Introducing HELMET: Holistically Evaluating Long-context Language Models

Step-Tagging: Toward controlling the generation of Language Reasoning Models through step monitoring

arXiv:2512. 14332v2 Announce Type: replace-cross Abstract: The field of Language Reasoning Models (LRMs) has been very active over the past few years with advances in training and inference techniques enabling LRMs to reason longer, and more accurately.

Cost of Reasoning in non-English Languages: A Case Study on Japanese

arXiv:2607. 10114v1 Announce Type: cross Abstract: Reasoning Language Models (RLMs) achieve their strongest performance when they reason in English, the language for which reasoning-oriented training data is most abundant.

Can LLMs Reason Structurally? Benchmarking via the Lens of Data Structures

arXiv:2505. 24069v4 Announce Type: replace-cross Abstract: Large language models (LLMs) are deployed on increasingly complex tasks that require multi-step decision-making.