arXiv Machine Learning By Yuelin Hu, Zhenbo Yu, Zhengxue Cheng, Wei Liu, Li Song

Hidden Failure Modes of Gradient Modification under Adam in Continual Learning, and Adaptive Decoupled Moment Routing as a Repair

Read the original on arXiv Machine Learning →

arXiv:2604. 22407v2 Announce Type: replace Abstract: Many continual-learning methods modify gradients upstream (e.

Machine-generated by The Flow from the publisher's headline and feed description — not written or checked by a human. The full article lives at arXiv Machine Learning.

arXiv AI
Aug 26

Restoring Without Forgetting: Continual Learning Across Image Degradations

The paper introduces Restoring without Forgetting (RwF), a continual learning framework for image restoration that handles multiple degradations sequentially without accessing prior data. RwF trains a lightweight adapter for each new degradation, uses an unsupervised routing mechanism to select the correct restoration path, and achieves significant PSNR gains over fine‑tuning on five benchmark degradation domains. The method also demonstrates strong transfer performance on eleven real‑degradation datasets with high routing accuracy.

By Alif Ashrafee, Bartosz Krawczyk
arXiv Machine Learning
Aug 4

AOS: Adaptive Optimizer Switching via Training-State Signals for Faster Convergence and Better Generalization

arXiv:2608. 01997v1 Announce Type: new Abstract: Single-optimizer training is a poor fit for the distinct phases of deep network optimization: adaptive methods handle noisy early gradients well but overshoot flat minima, while SGD with momentum generalizes better in the late phase but converges slowly early on.

By Alok Kumar Pandey, Umang Chaturvedi, Aatish Rana, Gopi Krishna Nedanuri