arXiv Machine Learning June 29, 2026 By Howard Chen, Noam Razin, Karthik Narasimhan, Danqi Chen

Retaining by Doing: The Role of On-Policy Data in Mitigating Forgetting

Read the original on arXiv Machine Learning →

arXiv:2510. 18874v3 Announce Type: replace Abstract: Adapting language models (LMs) to new tasks via post-training carries the risk of degrading existing capabilities -- a phenomenon classically known as catastrophic forgetting.

Summary generated by The Flow from the publisher's feed. The full article lives at arXiv Machine Learning.

arXiv Machine Learning

Jul 7

RL Forgets! Towards Continual Policy Optimization

arXiv:2607. 04364v1 Announce Type: new Abstract: Continual post-training is becoming a central paradigm for adapting vision-language models to evolving tasks.

By Mao-Lin Luo, Zhe-Xu Wang, Zi-Hao Zhou, Bo Ye, Jian Zhao, Min-Ling Zhang, Tong Wei

llms reinforcement-learning fine-tuning multimodal benchmarks

arXiv AI

Jun 19

Beyond Reasoning Gains: Mitigating General-Capability Forgetting in Large Reasoning Models

arXiv:2510. 21978v2 Announce Type: replace-cross Abstract: Reinforcement learning with verifiable rewards (RLVR) has delivered impressive gains in mathematical and multimodal reasoning and has become a standard post-training paradigm for contemporary language and vision-language models.

By Hoang Phan, Xianjun Yang, Yuanshun Yao, Jingyu Zhang, Shengjie Bi, Xiaocheng Tang, Madian Khabsa, Lijuan Liu, Deren Lei

llms reinforcement-learning multimodal benchmarks

arXiv Machine Learning

Jul 10

When Does Continual Learning Require Learning

arXiv:2607. 07847v1 Announce Type: new Abstract: As large language models (LLMs) become increasingly capable, the next question is how can we enable models to continually learn?

By Anne Harrington, Nayan Saxena, Michael Murphy, Anastasia Borovykh, Zeyu Yun, Sridhar Kamath, Ara Eindra Kyi, Trevor Darrell, Jitendra Malik, Yutong Bai

llms agents reinforcement-learning fine-tuning efficiency benchmarks

arXiv Machine Learning

Aug 4

Toward Plasticity-Preserving KL Regularization for Capability Retention in LLM Reinforcement Learning

arXiv:2608. 01743v1 Announce Type: new Abstract: Reinforcement learning (RL) has become a central paradigm for large language model (LLM) post-training, but optimization toward new objectives can degrade capabilities already present in the base model.

By Li Wang, Xiaodong Lu, Xiaohan Wang, Jiajun Chai, Wei Lin, Tianhao Peng, Guojun Yin

llms reinforcement-learning

arXiv Machine Learning

Aug 6

Unforgettable Generalization in Language Models

arXiv:2409. 02228v2 Announce Type: replace Abstract: When language models (LMs) are trained to forget (or "unlearn'') a skill, how precisely does their behavior change?

By Eric Zhang, Leshem Choshen, Jacob Andreas

llms nlp fine-tuning

arXiv Machine Learning

Aug 11

Catastrophic Forgetting in Continual Reinforcement Learning

arXiv:2608. 08673v1 Announce Type: new Abstract: This work explores the relationship between task similarity and catastrophic forgetting in reinforcement learning.

By Emma Graham

reinforcement-learning

Related stories

RL Forgets! Towards Continual Policy Optimization

Beyond Reasoning Gains: Mitigating General-Capability Forgetting in Large Reasoning Models

When Does Continual Learning Require Learning

Toward Plasticity-Preserving KL Regularization for Capability Retention in LLM Reinforcement Learning

Unforgettable Generalization in Language Models

Catastrophic Forgetting in Continual Reinforcement Learning