arXiv Machine Learning

Uncertainty-Aware Continual Learning for Open-World Intent Discovery Under an evolving Label Space

The paper introduces an uncertainty‑aware probabilistic framework for continual discovery of new user intents in open‑world settings where the label space evolves. It encodes utterances with an adaptive β‑VAE, uses classifier confidence, posterior uncertainty, and DP‑GMM likelihood to separate known from novel intents, and promotes only reliable clusters to new labels while employing replay and Elastic Weight Consolidation to avoid forgetting. Experiments demonstrate high novelty precision, stable adaptation across phases, and limited forgetting, with qualitative results showing coherent semantic clusters despite conservative label expansion.

arXiv Computer Vision
Oct 27

Task Relevance-Driven Prompt Expansion for Federated Continual Learning

arXiv:2610.34461v1 Announce Type: new Abstract: Federated continual learning (FCL) has attracted considerable interest by enabling local clients to continually acquire knowledge from new tasks. Howev...

By Jiahua Dong, Wenqi Liang, Yang Cong, Yichen Li, Hongyuan Yu, Henghui Ding, Yulun Zhang, Salman Khan, Fahad Shahbaz Khan
arXiv Machine Learning
Oct 8

Continual Learning without Continual Training

arXiv:2610.10379v1 Announce Type: new Abstract: Continual learning requires models to adapt to new domains and new classes while retaining prior knowledge. Many existing methods rely on continued opt...

By Nikita Narayanan, Ritham Majumdarr, Sonali Parbhoo
arXiv AI
Sep 7

Continual Graph Memory for Adaptive Recommendation under Intent Drift

The paper introduces CGM-Rec, a continual graph memory framework designed for adaptive recommendation in the presence of intent drift. CGM-Rec treats the knowledge graph as writable memory, comprising a conservative Semantic Graph Memory for stable relational knowledge and a fast-reactive Episodic Lesson Memory for recent outcomes and corrective hints. Experiments show that, with frozen model parameters and one-pass reranking, CGM-Rec outperforms neural and LLM-based baselines across multiple recommendation settings, achieving significant gains such as a 29.58% improvement in HR@1 over the strongest LLM baseline on Bundle.

By Hao Nguyen Ngoc, Tung Nguyen, Nguyen Thi Hanh, Hoang Thai Dinh, Nguyen Xuan Tung
arXiv AI
Aug 11

Beyond Static Models: An Evolving Framework for Continual Learning in Large Language Models across Training Stages

arXiv:2603. 12658v2 Announce Type: replace-cross Abstract: Continual learning (CL) has emerged as a pivotal paradigm to enable large language models (LLMs) to dynamically adapt to evolving knowledge and sequential tasks while mitigating catastrophic forgetting, a critical limitation of the static pre-training paradigm inherent to modern LLMs.

By Hongyang Chen, Zhongwu Sun, Hongfei Ye, Kunchi Li, Xuemin Lin
arXiv AI
Sep 28

Estimating and Orthogonalizing Unknown Pre-training Gradients for Continual Fine-tuning of Large Language Models

The paper introduces EoupCT, a framework that estimates and orthogonalizes unknown pre‑training gradients to mitigate catastrophic forgetting during continual fine‑tuning of large language models. It generates pseudo data most susceptible to forgetting using a learnable soft prompt with Gumbel‑Softmax, then jointly optimizes model parameters and the prompt via a first‑order Pareto optimizer to enforce orthogonality between new task updates and the estimated gradients. Experiments on multiple LLMs show that EoupCT preserves both task‑specific performance and the models’ inherent general‑purpose knowledge.

By Bing Wang, Changchun Li, Xin-Qiang Cai, Lin Yuanbo Wu, Ximing Li, Gang Niu, Masashi Sugiyama