arXiv Machine Learning June 9, 2026 By Emre Alyamac, Himanshu Janmeda, Shashwat Krishna, Yash Vijay

Evaluating the Impact of Task Granularity on Catastrophic Forgetting in Continual Learning

Read the original on arXiv Machine Learning →

arXiv:2606. 08013v1 Announce Type: new Abstract: Catastrophic forgetting, the abrupt loss of previously acquired knowledge upon learning new information, remains the central challenge in Continual Learning.

Summary generated by The Flow from the publisher's feed. The full article lives at arXiv Machine Learning.

arXiv Machine Learning

Aug 4

(How) Learning Rates Regulate Catastrophic Overtraining

arXiv:2604. 13627v2 Announce Type: replace Abstract: Supervised fine-tuning (SFT) is a common first stage of LLM post-training, teaching the model to follow instructions and shaping its behavior as a helpful assistant.

By Mark Rofin, Aditya Varre, Nicolas Flammarion

llms fine-tuning

arXiv Machine Learning

Jun 25

The Gentle Collapse: Distributional Metrics for Continual Learning

arXiv:2606. 25165v1 Announce Type: new Abstract: Accuracy degradation is the standard metric for Catastrophic Forgetting (CF), however, it records only whether forgetting occurred or not.

By Ahmed Anwar, Andreas Wagner, Federico Raue, Tobias Nauen, Andreas Dengel

arXiv Machine Learning

Jul 10

When Does Continual Learning Require Learning

arXiv:2607. 07847v1 Announce Type: new Abstract: As large language models (LLMs) become increasingly capable, the next question is how can we enable models to continually learn?

By Anne Harrington, Nayan Saxena, Michael Murphy, Anastasia Borovykh, Zeyu Yun, Sridhar Kamath, Ara Eindra Kyi, Trevor Darrell, Jitendra Malik, Yutong Bai

llms agents reinforcement-learning fine-tuning efficiency benchmarks

arXiv Machine Learning

Jun 5

Catastrophic Forgetting as Accessibility Collapse: A Three-Level Framework for Knowledge Persistence in Continual Learning

arXiv:2606. 06032v1 Announce Type: new Abstract: Catastrophic forgetting is commonly interpreted as the irreversible erasure of previously acquired knowledge during sequential learning.

By Ayushman Trivedi, Bhavika Melwani

arXiv Machine Learning

Jul 30

The Art of Not Forgetting A Local Learning Architecture for Continual Learning

arXiv:2607. 26523v1 Announce Type: new Abstract: We introduce CMP (Cognitive Memory Primitive), a continual-learning architecture that repre?

By Ashmith Atmuri, Yashaswini Rao Bhogarajula

llms benchmarks

arXiv AI

Jun 17

Position: Modular Memory is the Key to Continual Learning Agents

arXiv:2603. 01761v2 Announce Type: replace-cross Abstract: Foundation models have transformed machine learning through large-scale pretraining and increased test-time compute.

By Vaggelis Dorovatas, Malte Schwerin, Andrew D. Bagdanov, Lucas Caccia, Antonio Carta, Laurent Charlin, Barbara Hammer, Tyler L. Hayes, Timm Hess, Christopher Kanan, Dhireesha Kudithipudi, Xialei Liu, Vincenzo Lomonaco, Jorge Mendez-Mendez, Darshan Patil, Ameya Prabhu, Elisa Ricci, Tinne Tuytelaars, Gido M. van de Ven, Liyuan Wang, Joost van de Weijer, Jonghyun Choi, Martin Mundt, Rahaf Aljundi

llms agents

Related stories

(How) Learning Rates Regulate Catastrophic Overtraining

The Gentle Collapse: Distributional Metrics for Continual Learning

When Does Continual Learning Require Learning

Catastrophic Forgetting as Accessibility Collapse: A Three-Level Framework for Knowledge Persistence in Continual Learning

The Art of Not Forgetting A Local Learning Architecture for Continual Learning

Position: Modular Memory is the Key to Continual Learning Agents