arXiv Machine Learning
Jul 7
RL Forgets! Towards Continual Policy Optimization
arXiv:2607. 04364v1 Announce Type: new Abstract: Continual post-training is becoming a central paradigm for adapting vision-language models to evolving tasks.
Calibrated Partial Resets: Preventing Policy Collapse in Continual Reinforcement Learning
arXiv:2607. 24996v1 Announce Type: cross Abstract: Neural networks are hindered by accumulating dormant neurons and loss of expressivity throughout training, particularly in non-stationary data settings, such as continual supervised and reinforcement learning.
Related stories
arXiv Machine Learning
Jun 25
Stagnant Neuron: Towards Understanding the Plasticity Loss in Multi-Agent Reinforcement Learning Value Factorization Methods
arXiv:2606. 25335v1 Announce Type: new Abstract: Multi-Agent Reinforcement Learning (MARL) value factorization methods can suffer from a loss of plasticity, gradually failing to adapt when transferring to new task instances.
arXiv Machine Learning
Jul 21
Stochastic Resetting Accelerates Reinforcement Learning Beyond Random Search
arXiv:2603. 16842v2 Announce Type: replace Abstract: Stochastic resetting -- intermittently returning a process to a fixed reference state -- has emerged as an effective mechanism for optimizing first-passage properties.
arXiv AI
Aug 11
Dynamic gain neuromodulation attenuates the stability gap under joint training
arXiv:2507. 14056v3 Announce Type: replace-cross Abstract: Recent work in continual learning has highlighted the stability gap -- a temporary performance drop on previously learned tasks when new ones are introduced.
Hugging Face Trending Papers
Jun 24
Stagnant Neuron: Towards Understanding the Plasticity Loss in Multi-Agent Reinforcement Learning Value Factorization Methods
Multi-Agent Reinforcement Learning (MARL) value factorization methods can suffer from a loss of plasticity, gradually failing to adapt when transferring to new task instances. We trace this issue to stagnant neurons, units whose gradient updates become negligibly small relative to their weights, thereby hindering learning.
arXiv Machine Learning
Jun 16
Replay What Matters: Off-Policy Replay for Efficient LLM Reinforcement Unlearning
arXiv:2606. 15333v1 Announce Type: cross Abstract: LLM unlearning has emerged as a cost-effective alternative to full retraining for removing hazardous knowledge from pretrained models while preserving general utility.
arXiv Machine Learning
Aug 4
Plasticity of Growing and Elastic Neural Networks in Online Continual Learning
arXiv:2608. 01475v1 Announce Type: new Abstract: Neural networks that can grow or both grow and shrink during learning, referred to as growing neural networks and elastic neural networks, respectively, have recently been explored in offline continual learning with a particular focus on catastrophic forgetting.
arXiv Machine Learning
Aug 20
SingularClip: Preventing Spectral Collapse to Maintain Plasticity in Continual and Reinforcement Learning
The paper introduces SingularClip, a method that periodically clips the singular values of all weight matrices to prevent spectral collapse, a newly identified cause of plasticity loss in neural networks trained on nonstationary tasks. The authors empirically and theoretically analyze how growing anisotropy of singular values degrades the ability to fit new targets, and demonstrate that SingularClip outperforms baseline approaches in both continual supervised learning and deep reinforcement learning settings.
arXiv Machine Learning
Jul 30
The Art of Not Forgetting A Local Learning Architecture for Continual Learning
arXiv:2607. 26523v1 Announce Type: new Abstract: We introduce CMP (Cognitive Memory Primitive), a continual-learning architecture that repre?
arXiv Machine Learning
Jun 9
Theoretical Foundations of Continual Learning via Drift-Plus-Penalty
arXiv:2606. 08452v1 Announce Type: new Abstract: In many real-world settings, data streams are nonstationary and arrive sequentially, requiring learning systems to adapt continuously without retraining from scratch.
arXiv AI
Jul 29
Breaking the Curse of Repulsion: Remoteness-Aware Control of Negative Off-Policy Updates
arXiv:2602. 10430v2 Announce Type: replace-cross Abstract: Off-policy policy optimization reuses historical behavior, including negative-advantage samples that suppress known failures.
arXiv Machine Learning
Aug 13
Drift and Dependence: Layer-wise Information-Theoretic Bounds for Replay-Based Continual Learning
arXiv:2608. 11690v1 Announce Type: new Abstract: Continual learning must absorb new tasks without erasing old ones, and replay---mixing a small buffer of past examples into current training---is among the most effective remedies for catastrophic forgetting.