arXiv Machine Learning June 9, 2026 By Nazreen Shah, Govinda Arya, Bharath B. N., Ranjitha Prasad

Theoretical Foundations of Continual Learning via Drift-Plus-Penalty

Read the original on arXiv Machine Learning →

arXiv:2606. 08452v1 Announce Type: new Abstract: In many real-world settings, data streams are nonstationary and arrive sequentially, requiring learning systems to adapt continuously without retraining from scratch.

Machine-generated by The Flow from the publisher's headline and feed description — not written or checked by a human. The full article lives at arXiv Machine Learning.

benchmarks

arXiv Machine Learning

Aug 13

Drift and Dependence: Layer-wise Information-Theoretic Bounds for Replay-Based Continual Learning

arXiv:2608. 11690v1 Announce Type: new Abstract: Continual learning must absorb new tasks without erasing old ones, and replay---mixing a small buffer of past examples into current training---is among the most effective remedies for catastrophic forgetting.

By Tieliang Gong, Zhongbo Zhang, Wen Wen, Yong-Jin Liu

benchmarks safety

arXiv AI

Jul 8

To Retain or to Adapt? Generalizing Continual Learning

arXiv:2607. 05609v1 Announce Type: cross Abstract: The Continual Learning (CL) literature has long been driven by the goal of mitigating catastrophic forgetting.

By Giulia Lanzillotta, Mandana Samiei, Doina Precup, Razvan Pascanu, Claire Vernade

computer-vision reinforcement-learning benchmarks safety

arXiv Machine Learning

Jul 20

Rethinking Transfer in Continual Learning: A Replay-Based Realisation

arXiv:2607. 15587v1 Announce Type: new Abstract: Continual learning studies how deployed language models can continually acquire new tasks without expensive retraining from scratch.

By Yang Meng, Zhenya Liu, Zhuokai Zhao, Yuxin Chen

llms efficiency

arXiv Machine Learning

Jul 10

When Does Continual Learning Require Learning

arXiv:2607. 07847v1 Announce Type: new Abstract: As large language models (LLMs) become increasingly capable, the next question is how can we enable models to continually learn?

By Anne Harrington, Nayan Saxena, Michael Murphy, Anastasia Borovykh, Zeyu Yun, Sridhar Kamath, Ara Eindra Kyi, Trevor Darrell, Jitendra Malik, Yutong Bai

llms agents reinforcement-learning fine-tuning efficiency benchmarks

arXiv Machine Learning

2d ago

ReSCENE: Server-Side Replay for Structural Mitigation of Catastrophic Forgetting in Federated Continual Learning

arXiv:2609.38833v1 Announce Type: new Abstract: Federated continual learning must integrate new tasks over time without losing earlier-task knowledge. Most existing methods attach an anti-forgetting...

By Sungmin Kang, Zhengzhong Tu, Sunwoo Lee

arXiv AI

Aug 13

Representation Finetuning for Continual Learning

arXiv:2603. 11201v3 Announce Type: replace-cross Abstract: The world is inherently dynamic, and continual learning aims to enable models to adapt to ever-evolving data streams.

By Haihua Luo, Xuming Ran, Tommi K\"arkk\"ainen, Huiyan Xue, Zhonghua Chen, Qi Xu, Fengyu Cong

fine-tuning benchmarks

One email a morning, machine-written

Related stories

Drift and Dependence: Layer-wise Information-Theoretic Bounds for Replay-Based Continual Learning

To Retain or to Adapt? Generalizing Continual Learning

Rethinking Transfer in Continual Learning: A Replay-Based Realisation

When Does Continual Learning Require Learning

ReSCENE: Server-Side Replay for Structural Mitigation of Catastrophic Forgetting in Federated Continual Learning

Representation Finetuning for Continual Learning