arXiv Machine Learning August 14, 2026 By Qifan Zhang, Yunhui Guo, Yu Xiang

Continual Distillation Learning for Rehearsal-Free Class-Incremental Learning via Decoupled Prompting

Read the original on arXiv Machine Learning →

arXiv:2407. 13911v5 Announce Type: replace-cross Abstract: Prompt-based continual learning has shown strong performance in rehearsal-free class-incremental learning by adapting learnable prompts while freezing a pre-trained Vision Transformer (ViT) backbone.

Machine-generated by The Flow from the publisher's headline and feed description — not written or checked by a human. The full article lives at arXiv Machine Learning.

arXiv Machine Learning

Aug 26

GAP-Prompt: Gated Adaptive Prompting for Efficient Continual Learning

arXiv:2608.23782v1 Announce Type: new Abstract: Continual learning faces the persistent challenge of catastrophic forgetting, where sequential task updates degrade previously acquired knowledge. Whil...

By Trung-Anh Dang, Duy-Cuong Bui, Ngoc-Son Vu, Christel Vrain, Vincent Nguyen

llms efficiency benchmarks

arXiv Machine Learning

Aug 10

Self-Distillation Enables Continual Learning

arXiv:2601. 19897v2 Announce Type: replace Abstract: Continual learning, enabling models to acquire new skills and knowledge without degrading existing capabilities, remains a fundamental challenge for foundation models.

By Idan Shenfeld, Mehul Damani, Jonas H\"ubotter, Pulkit Agrawal

llms reinforcement-learning fine-tuning efficiency

arXiv Machine Learning

Jul 3

Denser $\neq$ Better: Limits of On-Policy Self-Distillation for Continual Post-Training

arXiv:2607. 01763v1 Announce Type: new Abstract: Continual post-training enables foundation models to acquire new knowledge while preserving existing capabilities.

By Meng Wang, Haohan Zhao, Wenzhuo Liu, Lu Yang, Geng Liu, Haiyang Guo, Guo-Sen Xie, Gaofeng Meng, Hongbin Liu, Fei Zhu

reinforcement-learning efficiency

arXiv Machine Learning

Sep 23

Information-Theoretic Decoupled Prompt Tuning for Continual Learning

arXiv:2609.26257v1 Announce Type: new Abstract: Continual learning (CL) aims to incrementally acquire knowledge from sequential data while avoiding catastrophic forgetting. Recently, prompt tuning ha...

By Yunfei Zhang, Wen Wen, Tieliang Gong, Weizhan Zhang

benchmarks safety

arXiv Machine Learning

Jul 10

When Does Continual Learning Require Learning

arXiv:2607. 07847v1 Announce Type: new Abstract: As large language models (LLMs) become increasingly capable, the next question is how can we enable models to continually learn?

By Anne Harrington, Nayan Saxena, Michael Murphy, Anastasia Borovykh, Zeyu Yun, Sridhar Kamath, Ara Eindra Kyi, Trevor Darrell, Jitendra Malik, Yutong Bai

llms agents reinforcement-learning fine-tuning efficiency benchmarks

arXiv Machine Learning

Jun 2

Turning Back Without Forgetting: Selective Backward Refinement for Parameter-Efficient Continual Learning

arXiv:2606. 01379v1 Announce Type: new Abstract: While prompt-based parameter-efficient continual learning mitigates catastrophic forgetting by isolating task-specific prompts, this isolation also limits later tasks from improving earlier ones, leaving backward knowledge transfer underexplored.

By Anushka Tiwari, Kaiyi Ji

llms benchmarks

One email a morning, machine-written

Related stories

GAP-Prompt: Gated Adaptive Prompting for Efficient Continual Learning

Self-Distillation Enables Continual Learning

Denser $\neq$ Better: Limits of On-Policy Self-Distillation for Continual Post-Training

Information-Theoretic Decoupled Prompt Tuning for Continual Learning

When Does Continual Learning Require Learning

Turning Back Without Forgetting: Selective Backward Refinement for Parameter-Efficient Continual Learning