Hugging Face Trending Papers July 8, 2026

MILES: Modular Instruction Memory with Learnable Selection for Self-Improving LLM Reasoning

Read the original on Hugging Face Trending Papers →

Large language models (LLMs) increasingly improve their reasoning at test time via additional computation, yet most existing works treat each problem in isolation. When problems arrive sequentially, accumulating reusable experience across them can further improve performance.

Summary generated by The Flow from the publisher's feed. The full article lives at Hugging Face Trending Papers.

arXiv Machine Learning

Jul 9

MILES: Modular Instruction Memory with Learnable Selection for Self-Improving LLM Reasoning

arXiv:2607. 06974v1 Announce Type: cross Abstract: Large language models (LLMs) increasingly improve their reasoning at test time via additional computation, yet most existing works treat each problem in isolation.

By Ruilin Tong, Dong Gong

llms rag

arXiv Machine Learning

Jun 17

Continual Self-Improvement with Lightweight Experiential Latent Memories

arXiv:2606. 17803v1 Announce Type: new Abstract: Large language models achieve strong reasoning performance by scaling inference-time compute, yet remain fundamentally stateless, discarding the rich, self-produced reasoning traces generated during this process.

By Vaggelis Dorovatas, Nancy Kalaj, Rahaf Aljundi

llms reinforcement-learning benchmarks

arXiv AI

Jul 21

SATQuest: A Verifier for Logical Reasoning Evaluation and Reinforcement Fine-Tuning of LLMs

arXiv:2509. 00930v2 Announce Type: replace Abstract: Large language models (LLMs) exhibit strong general reasoning, yet the community lacks controllable, scalable, and verifiable tools to analyze and improve these abilities.

By Yanxiao Zhao, Yaqian Li, Zihao Bo, Rinyoichi Takezoe, Haojia Hui, Mo Guang, Lei Ren, Xiaolin Qin, Kaiwen Long

llms fine-tuning benchmarks

arXiv AI

Jun 9

AlphaOPT: Formulating Optimization Programs with Self-Improving LLM Experience Library

arXiv:2510. 18428v4 Announce Type: replace Abstract: Optimization modeling underlies critical decision-making across industries, yet remains difficult to automate: natural-language problem descriptions must be translated into precise mathematical formulations and executable solver code.

By Minwei Kong, Ao Qu, Xiaotong Guo, Wenbin Ouyang, Chonghe Jiang, Han Zheng, Yining Ma, Dingyi Zhuang, Yuhan Tang, Junyi Li, Shenhao Wang, Haris Koutsopoulos, Hai Wang, Cathy Wu, Jinhua Zhao

llms benchmarks

arXiv Machine Learning

Jul 17

Leveraging Instruction Tuning and Merging for Reasoning Model Adaptation

arXiv:2607. 14895v1 Announce Type: new Abstract: Reasoning language models (RLMs) have demonstrated impressive performance in domains such as mathematics and coding.

By Yu-Du Feng, Niels M\"undler-Sasahara, Mark Vero, Martin Vechev

llms nlp reinforcement-learning fine-tuning

arXiv AI

Jul 28

MemChain: Learning Interpretable Memory Traces for Memory-Augmented LLM Agents

arXiv:2607. 24097v1 Announce Type: new Abstract: Memory-augmented LLM agents typically answer queries by retrieving relevant memories and feeding them directly to an answer model.

By Yiwen Ma, Songjun Tu, Qichao Zhang, Dong Li, Linjing Li, Dongbin Zhao

llms agents reinforcement-learning benchmarks

Related stories

MILES: Modular Instruction Memory with Learnable Selection for Self-Improving LLM Reasoning

Continual Self-Improvement with Lightweight Experiential Latent Memories

SATQuest: A Verifier for Logical Reasoning Evaluation and Reinforcement Fine-Tuning of LLMs

AlphaOPT: Formulating Optimization Programs with Self-Improving LLM Experience Library

Leveraging Instruction Tuning and Merging for Reasoning Model Adaptation

MemChain: Learning Interpretable Memory Traces for Memory-Augmented LLM Agents