OpenAI Blog

Learning to reason with LLMs

arXiv Computation and Language
Aug 28

Reasoning about In-Context Samples for Machine-Translation

The paper proposes a fragment‑based reasoning framework for large language model–based machine translation. It extracts parallel source‑target fragments from retrieved similar examples and uses these fragments as intermediate reasoning traces to generate the final translation. Experiments with the Qwen3 model across six languages and multiple domains show that this approach outperforms standard k‑shot or basic drafting methods.

By Maxime Bouthors, Josep Crego, Fran\c{c}ois Yvon
arXiv AI
Aug 19

Structure-Internalized Rule Language Model for Faithful Knowledge Graph Reasoning

The paper introduces the Structure-Internalized Rule Language Model (SIRLM) to improve Knowledge Graph Reasoning (KGR) by addressing the mismatch between KG structural context and Large Language Model (LLM) parametric knowledge. SIRLM centers on a Structure-Internalized Rule Generator (SIRG) that uses in-context learning, a structural relation memory, a KG tokenizer, and a neuro-symbolic reasoner to generate structural rules and provide faithful rule-execution feedback. Experiments on 36 datasets against 17 state‑of‑the‑art KGR methods show that SIRLM achieves significant performance gains.

By Xingrui Zhuo, Jiapu Wang, Manzong Huang, Gongqing Wu, Xindong Wu