arXiv Machine Learning June 2, 2026 By Anushka Tiwari, Kaiyi Ji

Turning Back Without Forgetting: Selective Backward Refinement for Parameter-Efficient Continual Learning

Read the original on arXiv Machine Learning →

arXiv:2606. 01379v1 Announce Type: new Abstract: While prompt-based parameter-efficient continual learning mitigates catastrophic forgetting by isolating task-specific prompts, this isolation also limits later tasks from improving earlier ones, leaving backward knowledge transfer underexplored.

Machine-generated by The Flow from the publisher's headline and feed description — not written or checked by a human. The full article lives at arXiv Machine Learning.

arXiv Machine Learning

Jul 20

Rethinking Transfer in Continual Learning: A Replay-Based Realisation

arXiv:2607. 15587v1 Announce Type: new Abstract: Continual learning studies how deployed language models can continually acquire new tasks without expensive retraining from scratch.

By Yang Meng, Zhenya Liu, Zhuokai Zhao, Yuxin Chen

llms efficiency

arXiv Machine Learning

Aug 13

Drift and Dependence: Layer-wise Information-Theoretic Bounds for Replay-Based Continual Learning

arXiv:2608. 11690v1 Announce Type: new Abstract: Continual learning must absorb new tasks without erasing old ones, and replay---mixing a small buffer of past examples into current training---is among the most effective remedies for catastrophic forgetting.

By Tieliang Gong, Zhongbo Zhang, Wen Wen, Yong-Jin Liu

benchmarks safety

arXiv Machine Learning

Sep 23

Information-Theoretic Decoupled Prompt Tuning for Continual Learning

arXiv:2609.26257v1 Announce Type: new Abstract: Continual learning (CL) aims to incrementally acquire knowledge from sequential data while avoiding catastrophic forgetting. Recently, prompt tuning ha...

By Yunfei Zhang, Wen Wen, Tieliang Gong, Weizhan Zhang

benchmarks safety

arXiv Machine Learning

Jul 10

When Does Continual Learning Require Learning

arXiv:2607. 07847v1 Announce Type: new Abstract: As large language models (LLMs) become increasingly capable, the next question is how can we enable models to continually learn?

By Anne Harrington, Nayan Saxena, Michael Murphy, Anastasia Borovykh, Zeyu Yun, Sridhar Kamath, Ara Eindra Kyi, Trevor Darrell, Jitendra Malik, Yutong Bai

llms agents reinforcement-learning fine-tuning efficiency benchmarks

arXiv Machine Learning

Jul 30

The Art of Not Forgetting A Local Learning Architecture for Continual Learning

arXiv:2607. 26523v1 Announce Type: new Abstract: We introduce CMP (Cognitive Memory Primitive), a continual-learning architecture that repre?

By Ashmith Atmuri, Yashaswini Rao Bhogarajula

llms benchmarks

arXiv Machine Learning

Jul 14

Attribution-Guided Continual Learning for Large Language Models

arXiv:2605. 05285v2 Announce Type: replace Abstract: Large language models (LLMs) often suffer from catastrophic forgetting in continual learning: after learning new tasks sequentially, they perform worse on earlier tasks.

By Yazheng Liu, Yuxuan Wan, Rui Xu, Xi Zhang, Sihong Xie, Hui Xiong

llms fine-tuning

One email a morning, machine-written

Related stories

Rethinking Transfer in Continual Learning: A Replay-Based Realisation

Drift and Dependence: Layer-wise Information-Theoretic Bounds for Replay-Based Continual Learning

Information-Theoretic Decoupled Prompt Tuning for Continual Learning

When Does Continual Learning Require Learning

The Art of Not Forgetting A Local Learning Architecture for Continual Learning

Attribution-Guided Continual Learning for Large Language Models