arXiv AI
On the Dynamics of Delayed Generalization in Linear Models
Read the original on arXiv AI →The Flow has not summarised this story yet — read it at arXiv AI.
Related stories
arXiv Machine Learning
Sep 10
A Theoretical Analysis of Generalization Dynamics in Neural Networks under Gradient Descent with Weight Decay
arXiv:2609.07755v1 Announce Type: new Abstract: Understanding generalization remains a central challenge in machine learning because it requires jointly considering data, architecture, and training d...
arXiv Machine Learning
Sep 10
The Dynamics of Generalization in Deep Learning
arXiv:2504.16450v4 Announce Type: replace Abstract: We derive a differential equation that governs the evolution of the generalization gap when a model is trained by gradient descent-based methods. T...
arXiv Statistics ML
Oct 26
Early learning in large residual networks
arXiv:2610.31783v1 Announce Type: new Abstract: We study the early training dynamics of nonlinear residual networks with blocks of zero hidden layers as a model of more general residual networks. We...
arXiv Machine Learning
Jul 17
To Grok Grokking: Provable Grokking in Ridge Regression
arXiv:2601. 19791v4 Announce Type: replace Abstract: We study grokking, the onset of generalization long after overfitting, in a classical ridge regression setting.
arXiv AI
Jun 2
The Geometry of Grokking: Norm Minimization on the Zero-Loss Manifold
arXiv:2511. 01938v3 Announce Type: replace-cross Abstract: Grokking is a puzzling phenomenon in neural networks where full generalization occurs only after a substantial delay following the complete memorization of the training data.
arXiv Machine Learning
Jun 5
A prism hierarchy of learning regimes in large linear autoencoders
arXiv:2606. 05335v1 Announce Type: new Abstract: Theoretical studies of machine learning models commonly consider different limiting regimes in which the learning dynamics of gradient descent becomes theoretically tractable.