arXiv AI

Restoring Without Forgetting: Continual Learning Across Image Degradations

The paper introduces Restoring without Forgetting (RwF), a continual learning framework for image restoration that handles multiple degradations sequentially without accessing prior data. RwF trains a lightweight adapter for each new degradation, uses an unsupervised routing mechanism to select the correct restoration path, and achieves significant PSNR gains over fine‑tuning on five benchmark degradation domains. The method also demonstrates strong transfer performance on eleven real‑degradation datasets with high routing accuracy.

arXiv AI
Jul 22

Soft-TransFormers for Continual Learning

arXiv:2411. 16073v4 Announce Type: replace-cross Abstract: Inspired by the Well-initialized Lottery Ticket Hypothesis (WLTH), we introduce Soft-TransFormers (Soft-TF), a continual learning framework that adapts a frozen pre-trained Transformer through task-specific soft subnetworks: real-valued multiplicative masks over the query, key, value, and output projections of selected self-attention layers.

By Haeyong Kang, Chang D. Yoo
arXiv AI
Jul 21

The Art of Not Forgetting

arXiv:2607. 17944v1 Announce Type: cross Abstract: We introduce CMP (Cognitive Memory Primitive), an architecture that represents inputs as sparse relational codes, stores them in a two-tier competitive memory, and learns entirely through local, gradient-free updates, with no backpropagation anywhere in the network.

By Ashmith Atmuri, Akshay Kumar, Yashaswini Rao Bhogarajula
arXiv AI
Sep 1

On the Plasticity Collapse in Continual Machine Unlearning

The paper investigates continual machine unlearning, where models must forget data over time. It identifies a fundamental issue called plasticity collapse, where successive unlearning requests cause geometric constraints that saturate parameter space, leading to two failure modes: forward failure (reduced forgetting quality) and backward failure (re‑memorization). Experiments across architectures and datasets confirm that plasticity collapse is a pervasive problem in continual unlearning.

By Yingdan Shi, Xiang Xu, Kaize Ding, Alfred O. Hero, Ren Wang
arXiv AI
Oct 9

EvoKnow: Continual Knowledge Evolution for AI-Generated Image Detection

EvoKnow is a replay‑free framework for continual AI‑generated image detection that treats forensic knowledge as evolving. It keeps a shared forensic basis from base domains, adds isolated residual experts for new generators, and uses an Analytical Incremental Router (AIR) updated in closed form from current‑stage data and accumulated statistics. Experiments show strong cross‑generator generalization, few‑shot expansion, and low forgetting, achieving 96.70% accuracy on non‑base generators and 96.32% mean stage‑wise accuracy under a strict replay‑free protocol.

By Zhiheng Peng, Wenwei Jin, Yangshi Ge, Siyu Xia, Jiawei Li, Xu Tang
arXiv AI
Jul 15

Continual Learning with Elastic Regularization and Synthetic Replay for Federated MLLM Fine-Tuning

arXiv:2607. 12112v1 Announce Type: cross Abstract: Federated fine-tuning of Multimodal Large Language Models (MLLMs) across distributed networks enables privacy-sensitive adaptation to evolving data streams, yet a fundamental obstacle prevents robust deployment in dynamic environments: catastrophic forgetting, wherein sequential task updates erase previously acquired knowledge across visual, linguistic, and cross-modal representations.

By Jing Liu, Chenxuanyin Zou, Jiayang Ren, Gaoyun Fang, Chengfang Li, Yan Wang, Zhenchao Ma, Bo Hu