arXiv Machine Learning August 3, 2026 By Xiaotian Zhang, Lai Shun Chan, Yue Shang, Entao Yang, Ge Zhang

The Grokked Illusion: True Equilibrium Mitigates Catastrophic Forgetting

Read the original on arXiv Machine Learning →

arXiv:2607. 29503v1 Announce Type: new Abstract: While neural networks are typically evaluated by their training and test performance, these metrics do not reveal how robust a learned representation is.

Machine-generated by The Flow from the publisher's headline and feed description — not written or checked by a human. The full article lives at arXiv Machine Learning.

llms

arXiv Machine Learning

Aug 6

Unforgettable Generalization in Language Models

arXiv:2409. 02228v2 Announce Type: replace Abstract: When language models (LMs) are trained to forget (or "unlearn'') a skill, how precisely does their behavior change?

By Eric Zhang, Leshem Choshen, Jacob Andreas

llms nlp fine-tuning

arXiv Machine Learning

Jul 28

Forgetting is Everywhere

arXiv:2511. 04666v4 Announce Type: replace Abstract: A fundamental challenge in developing general learning algorithms is their tendency to forget past knowledge as they adapt to new data.

By Ben Sanati, Thomas L. Lee, Trevor McInroe, Aidan Scannell, Esmeralda S. Whitammer, David Abel, Amos Storkey

reinforcement-learning

arXiv AI

2d ago

Local Support Learning

arXiv:2610.02126v1 Announce Type: cross Abstract: We explore catastrophic forgetting in the context of large pre-trained models. By considering forgetting as a geometric problem in the input space of...

By Assaf Ben-Kish, Akarsh Kumar, James Glass, Raja Giryes

llms

arXiv Machine Learning

Jun 16

Mechanistic Analysis of Catastrophic Forgetting in Large Language Models During Continual Fine-tuning

arXiv:2601. 18699v2 Announce Type: replace Abstract: Sequential fine-tuning of Large Language Models (LLMs) adaptation to target tasks often triggers catastrophic forgetting, where the acquisition of novel target skills degrades ancestral capabilities.

By Gustav Olaf Yunus Laitinen-Fredriksson Lundstrom-Imanov

llms fine-tuning benchmarks safety

arXiv AI

Jun 30

Informational Frustration in Neural Manifolds: Shannon Bottlenecks and the Limits of Learnability

arXiv:2606. 30512v1 Announce Type: cross Abstract: Why overparameterised deep networks generalise so remarkably well remains one of the most stubborn open questions in machine learning theory.

By Srinivasa Rao P., Vangmayi P Reddy

arXiv Computer Vision

4d ago

Weeding Out Bad Seeds: Initial-Noise-Robust Unlearning for Text-to-Image Diffusion Models

arXiv:2609.37537v1 Announce Type: new Abstract: Machine unlearning has emerged as a critical post-hoc safety measure to erase sensitive concepts from Text-to-Image (T2I) models without prohibitive re...

By Arian Komaei Koma, Seyed Amir Kasaei, Aida Aryafar, Matin Ghiasi, Ali Aghayari, Amirhossein Souri, Mohammad Mosayyebi, AmirMahdi Sadeghzadeh, Mohammad Hossein Rohban

diffusion benchmarks safety

One email a morning, machine-written

Related stories

Unforgettable Generalization in Language Models

Forgetting is Everywhere

Local Support Learning

Mechanistic Analysis of Catastrophic Forgetting in Large Language Models During Continual Fine-tuning

Informational Frustration in Neural Manifolds: Shannon Bottlenecks and the Limits of Learnability

Weeding Out Bad Seeds: Initial-Noise-Robust Unlearning for Text-to-Image Diffusion Models