arXiv Machine Learning August 4, 2026 By Pengxiang Wang, Hongbo Bo, Jun Hong, Weiru Liu, Kedian Mu

AdaHAT: Adaptive Hard Attention to the Task in Task-Incremental Learning

Read the original on arXiv Machine Learning →

arXiv:2608. 01252v1 Announce Type: new Abstract: Catastrophic forgetting is a major problem in task-incremental learning, where neural networks tend to overwrite previously learned knowledge when trained on new tasks.

Machine-generated by The Flow from the publisher's headline and feed description — not written or checked by a human. The full article lives at arXiv Machine Learning.

arXiv Machine Learning

Sep 16

CLARE: Scalable Class-Incremental Continual Learning via a Sparsity-Based Framework

arXiv:2609.17026v1 Announce Type: new Abstract: Continual learning must balance the learning of new knowledge with the retention of previously learned knowledge to incrementally learn tasks from a da...

By Yunxiang Fu, Meng Lou, Zicheng Liao, Yizhou Yu

fine-tuning efficiency benchmarks

arXiv AI

Jul 22

Soft-TransFormers for Continual Learning

arXiv:2411. 16073v4 Announce Type: replace-cross Abstract: Inspired by the Well-initialized Lottery Ticket Hypothesis (WLTH), we introduce Soft-TransFormers (Soft-TF), a continual learning framework that adapts a frozen pre-trained Transformer through task-specific soft subnetworks: real-valued multiplicative masks over the query, key, value, and output projections of selected self-attention layers.

By Haeyong Kang, Chang D. Yoo

llms fine-tuning benchmarks

arXiv AI

Jul 22

Parameter-Efficient Continual Fine-Tuning: A Survey

arXiv:2504. 13822v3 Announce Type: replace-cross Abstract: The emergence of large pre-trained networks has revolutionized the AI field, unlocking new possibilities and achieving unprecedented performance.

By Eric Nuertey Coleman, Luigi Quarantiello, Ziyue Liu, Qinwen Yang, Samrat Mukherjee, Julio Hurtado, Vincenzo Lomonaco

fine-tuning benchmarks

arXiv AI

Jul 8

To Retain or to Adapt? Generalizing Continual Learning

arXiv:2607. 05609v1 Announce Type: cross Abstract: The Continual Learning (CL) literature has long been driven by the goal of mitigating catastrophic forgetting.

By Giulia Lanzillotta, Mandana Samiei, Doina Precup, Razvan Pascanu, Claire Vernade

computer-vision reinforcement-learning benchmarks safety

arXiv Machine Learning

Sep 1

One Adapter, Many Tasks: Task-Conditioned Feature Transformations for Continual Learning

arXiv:2608.31096v1 Announce Type: cross Abstract: Class-incremental learning (CIL) requires a model to incrementally learn tasks that contain new classes without accessing earlier training data while...

By Yunxiang Fu, Meng Lou, Yizhou Yu

fine-tuning

arXiv Machine Learning

Jul 28

Gradient-Free Continual Learning

arXiv:2504. 01219v2 Announce Type: replace Abstract: Neural networks are notorious for forgetting old skills when taught new ones - a problem known as catastrophic forgetting.

By Grzegorz Rype\'s\'c

benchmarks safety

One email a morning, machine-written

Related stories

CLARE: Scalable Class-Incremental Continual Learning via a Sparsity-Based Framework

Soft-TransFormers for Continual Learning

Parameter-Efficient Continual Fine-Tuning: A Survey

To Retain or to Adapt? Generalizing Continual Learning

One Adapter, Many Tasks: Task-Conditioned Feature Transformations for Continual Learning

Gradient-Free Continual Learning