arXiv Machine Learning August 18, 2026 By Zhiming Xu, Huiyu Yi, Zhen-Hao Xie, Baile Xu, Furao Shen, Jian Zhao, Suorong Yang

Task-Anchored Representation Shaping for Pre-Trained Model-Based Continual Learning

Read the original on arXiv Machine Learning →

arXiv:2608. 16345v1 Announce Type: new Abstract: Pre-trained models (PTMs) provide a strong foundation for continual learning by offering stable representations that facilitate lightweight adaptation to new tasks.

Machine-generated by The Flow from the publisher's headline and feed description — not written or checked by a human. The full article lives at arXiv Machine Learning.

arXiv AI

Aug 13

Representation Finetuning for Continual Learning

arXiv:2603. 11201v3 Announce Type: replace-cross Abstract: The world is inherently dynamic, and continual learning aims to enable models to adapt to ever-evolving data streams.

By Haihua Luo, Xuming Ran, Tommi K\"arkk\"ainen, Huiyan Xue, Zhonghua Chen, Qi Xu, Fengyu Cong

fine-tuning benchmarks

arXiv Machine Learning

Sep 10

Continual Learning Mechanisms Compose for Long-Horizon Memorization

arXiv:2609.06986v1 Announce Type: new Abstract: Language models may need to internalize information that arrives over time and retain it through many subsequent updates. To study this challenge, we i...

By Zheyuan Zhang, Alvin Zhang, Daniel Khashabi, Tianmin Shu

llms fine-tuning

arXiv Machine Learning

Sep 16

CLARE: Scalable Class-Incremental Continual Learning via a Sparsity-Based Framework

arXiv:2609.17026v1 Announce Type: new Abstract: Continual learning must balance the learning of new knowledge with the retention of previously learned knowledge to incrementally learn tasks from a da...

By Yunxiang Fu, Meng Lou, Zicheng Liao, Yizhou Yu

fine-tuning efficiency benchmarks

arXiv AI

Jun 8

Sparse Subspace-to-Expert Sharing for Task-Agnostic Continual Learning

arXiv:2606. 07500v1 Announce Type: cross Abstract: Continual learning in Large Language Models (LLMs) is hindered by the plasticity-stability dilemma, where acquiring new capabilities often leads to catastrophic forgetting of previous knowledge.

By Fatema Siddika, Md Anwar Hossen, Tanwi Mallick, Ali Jannesari

llms benchmarks

arXiv Machine Learning

Sep 1

One Adapter, Many Tasks: Task-Conditioned Feature Transformations for Continual Learning

arXiv:2608.31096v1 Announce Type: cross Abstract: Class-incremental learning (CIL) requires a model to incrementally learn tasks that contain new classes without accessing earlier training data while...

By Yunxiang Fu, Meng Lou, Yizhou Yu

fine-tuning

arXiv Machine Learning

Jul 10

When Does Continual Learning Require Learning

arXiv:2607. 07847v1 Announce Type: new Abstract: As large language models (LLMs) become increasingly capable, the next question is how can we enable models to continually learn?

By Anne Harrington, Nayan Saxena, Michael Murphy, Anastasia Borovykh, Zeyu Yun, Sridhar Kamath, Ara Eindra Kyi, Trevor Darrell, Jitendra Malik, Yutong Bai

llms agents reinforcement-learning fine-tuning efficiency benchmarks

One email a morning, machine-written

Related stories

Representation Finetuning for Continual Learning

Continual Learning Mechanisms Compose for Long-Horizon Memorization

CLARE: Scalable Class-Incremental Continual Learning via a Sparsity-Based Framework

Sparse Subspace-to-Expert Sharing for Task-Agnostic Continual Learning

One Adapter, Many Tasks: Task-Conditioned Feature Transformations for Continual Learning

When Does Continual Learning Require Learning