arXiv Machine Learning August 4, 2026 By Jeong Min Kong, Richard S. Sutton

Plasticity of Growing and Elastic Neural Networks in Online Continual Learning

Read the original on arXiv Machine Learning →

arXiv:2608. 01475v1 Announce Type: new Abstract: Neural networks that can grow or both grow and shrink during learning, referred to as growing neural networks and elastic neural networks, respectively, have recently been explored in offline continual learning with a particular focus on catastrophic forgetting.

Summary generated by The Flow from the publisher's feed. The full article lives at arXiv Machine Learning.

arXiv AI

Jul 8

To Retain or to Adapt? Generalizing Continual Learning

arXiv:2607. 05609v1 Announce Type: cross Abstract: The Continual Learning (CL) literature has long been driven by the goal of mitigating catastrophic forgetting.

By Giulia Lanzillotta, Mandana Samiei, Doina Precup, Razvan Pascanu, Claire Vernade

computer-vision reinforcement-learning benchmarks safety

arXiv Machine Learning

Jul 28

Gradient-Free Continual Learning

arXiv:2504. 01219v2 Announce Type: replace Abstract: Neural networks are notorious for forgetting old skills when taught new ones - a problem known as catastrophic forgetting.

By Grzegorz Rype\'s\'c

benchmarks safety

arXiv AI

Jul 22

Parameter-Efficient Continual Fine-Tuning: A Survey

arXiv:2504. 13822v3 Announce Type: replace-cross Abstract: The emergence of large pre-trained networks has revolutionized the AI field, unlocking new possibilities and achieving unprecedented performance.

By Eric Nuertey Coleman, Luigi Quarantiello, Ziyue Liu, Qinwen Yang, Samrat Mukherjee, Julio Hurtado, Vincenzo Lomonaco

fine-tuning benchmarks

arXiv Machine Learning

Jun 9

Evaluating the Impact of Task Granularity on Catastrophic Forgetting in Continual Learning

arXiv:2606. 08013v1 Announce Type: new Abstract: Catastrophic forgetting, the abrupt loss of previously acquired knowledge upon learning new information, remains the central challenge in Continual Learning.

By Emre Alyamac, Himanshu Janmeda, Shashwat Krishna, Yash Vijay

arXiv AI

6d ago

Representation Finetuning for Continual Learning

arXiv:2603. 11201v3 Announce Type: replace-cross Abstract: The world is inherently dynamic, and continual learning aims to enable models to adapt to ever-evolving data streams.

By Haihua Luo, Xuming Ran, Tommi K\"arkk\"ainen, Huiyan Xue, Zhonghua Chen, Qi Xu, Fengyu Cong

fine-tuning benchmarks

arXiv AI

Jun 9

Preserving Plasticity in Continual Learning via Dynamical Isometry

arXiv:2606. 09762v1 Announce Type: cross Abstract: Continual training of deep neural networks under non-stationarity often leads to a progressive loss of plasticity, eventually limiting further learning.

By Andries Rosseau, Robert M\"uller, Ann Now\'e

benchmarks

Related stories

To Retain or to Adapt? Generalizing Continual Learning

Gradient-Free Continual Learning

Parameter-Efficient Continual Fine-Tuning: A Survey

Evaluating the Impact of Task Granularity on Catastrophic Forgetting in Continual Learning

Representation Finetuning for Continual Learning

Preserving Plasticity in Continual Learning via Dynamical Isometry