arXiv Computer Vision

Knowing Beyond the Known: Reinforced Knowledge Specification for Multi-Label Class-Incremental Learning

arXiv Machine Learning
Oct 9

Class Machine Unlearning for Complex Data via Concepts Inference and Data Poisoning

The paper introduces a concept-guided poisoning unlearning framework that explicitly identifies semantic concepts most strongly linked to a target class or knowledge. For image classification, it uses a Post-hoc Concept Bottleneck Model to locate relevant image regions and creates poisoned samples; for large language models, it aggregates Integrated Gradients over multiple question responses to mask important content and generate poisoned training targets. Experiments across several datasets demonstrate effective unlearning while largely preserving model utility.

By Wenhan Chang, Tianqing Zhu, Heng Xu, Wenjian Liu, Wanlei Zhou
arXiv AI
Jun 19

Beyond Reasoning Gains: Mitigating General-Capability Forgetting in Large Reasoning Models

arXiv:2510. 21978v2 Announce Type: replace-cross Abstract: Reinforcement learning with verifiable rewards (RLVR) has delivered impressive gains in mathematical and multimodal reasoning and has become a standard post-training paradigm for contemporary language and vision-language models.

By Hoang Phan, Xianjun Yang, Yuanshun Yao, Jingyu Zhang, Shengjie Bi, Xiaocheng Tang, Madian Khabsa, Lijuan Liu, Deren Lei
arXiv Machine Learning
Oct 5

CLEAN: Psychometrically Consistent Incremental Cognitive Diagnosis under Concept-Space Expansion via Architectural Isolation

CLEAN (Continual Learning with Expandable and Architecturally Isolated Networks) is an incremental cognitive diagnosis framework that allows the concept space to grow while guaranteeing that historical diagnoses remain unchanged. It achieves this by freezing past diagnostic functions, applying orthogonal column masking to prevent gradient interference, and adding expandable full‑rank branches with micro‑variance initialization for new concepts. Experiments on three large‑scale educational datasets show that CLEAN attains zero Representation Drift, preserving old‑item metrics exactly while performing competitively on new items.

By Tao He, Jinxing Xiang, Fan Jiang
arXiv AI
Aug 20

Forgetting, plasticity, and co-observation: a third facet of continual learning

The paper argues that catastrophic forgetting and loss of plasticity alone cannot explain why naive sequential training underperforms offline joint training. It introduces data co-observation as a third factor, showing that observing training data together consistently improves performance across supervised and self-supervised settings. The study also reinterprets common continual learning methods, suggesting that memory replay’s success stems from restoring co-observation benefits rather than merely mitigating forgetting.

By Timm Hess, Abhishek Jha, Gido M. van de Ven, Tinne Tuytelaars
arXiv Machine Learning
Oct 8

Continual Learning without Continual Training

arXiv:2610.10379v1 Announce Type: new Abstract: Continual learning requires models to adapt to new domains and new classes while retaining prior knowledge. Many existing methods rely on continued opt...

By Nikita Narayanan, Ritham Majumdarr, Sonali Parbhoo