arXiv Machine Learning
Aug 4
Benign Overfitting in Linear Classifiers with a Bias Term
arXiv:2511. 12840v2 Announce Type: replace-cross Abstract: Overparameterized models often generalize well even when they interpolate noisy training data.
Universality of Benign Overfitting in Binary Linear Classification
arXiv:2501. 10538v3 Announce Type: replace Abstract: The practical success of deep learning has led to the discovery of several surprising phenomena.
Related stories
arXiv Machine Learning
Aug 7
Minimax Optimal Early-Stopped Gradient Descent for Gaussian Mixture Classification
arXiv:2608. 06250v1 Announce Type: cross Abstract: In overparameterised classification, training data can be linearly separable even when the underlying distribution is not.
arXiv Machine Learning
Jul 7
Benign Overfitting Does Not Occur in Diffusion Models
arXiv:2607. 02671v1 Announce Type: cross Abstract: Benign overfitting and double descent have come to shape our understanding of generalization in deep learning, establishing that overfitting is not only compatible with good generalization but can actively benefit it.
arXiv Machine Learning
Jul 16
How the Hessian-Spectrum of Neural Networks Depends on Data
arXiv:2607. 13631v1 Announce Type: new Abstract: The Hessian matrix is an important quantity of interest when it comes to studying the loss landscape and optimization dynamics in deep learning, as well as designing measures of generalization, second-order learning algorithms, etc.
arXiv Machine Learning
Jun 19
Benign overfitting beyond prediction: The ordinary least squares interpolator
arXiv:2309. 15769v3 Announce Type: replace-cross Abstract: Recent advances in deep learning have highlighted the phenomenon of benign overfitting in overparameterized statistical models, sparking significant interest in understanding its foundations.
arXiv Machine Learning
Aug 11
No Unique Minimizer, No Problem: On the Consistency of Robust Neural Classifiers
arXiv:2608. 08489v1 Announce Type: new Abstract: Neural network classifiers trained by cross-entropy minimization are highly sensitive to label noise and adversarial contamination.
arXiv Machine Learning
Jul 27
The Role of Pseudo-labels in Self-training Linear Classifiers on High-dimensional Gaussian Mixture Data
arXiv:2205. 07739v4 Announce Type: replace-cross Abstract: Self-training (ST) is a simple yet effective semi-supervised learning method.
Hugging Face Trending Papers
Jul 15
How the Hessian-Spectrum of Neural Networks Depends on Data
The Hessian matrix is an important quantity of interest when it comes to studying the loss landscape and optimization dynamics in deep learning, as well as designing measures of generalization, second-order learning algorithms, etc. Prior works have focused on empirical results or pursued a theoretical treatment under overly simplified settings.
arXiv Machine Learning
Jul 17
To Grok Grokking: Provable Grokking in Ridge Regression
arXiv:2601. 19791v4 Announce Type: replace Abstract: We study grokking, the onset of generalization long after overfitting, in a classical ridge regression setting.
arXiv AI
Jun 16
ALCL: An Adaptive Log-Correntropy Loss for Robust Learning under Non-Gaussian Noise
arXiv:2606. 16050v1 Announce Type: cross Abstract: Robust deep learning under heavy-tailed and impulsive noise remains challenging because conventional losses such as mean squared error (MSE) exhibit unbounded sensitivity to outliers.
arXiv AI
Jun 16
Upper Bounds on the Generalization Error of Deep Learning Models via Local Robustness and Stability
arXiv:2606. 16883v1 Announce Type: cross Abstract: Generalization is a critical property of data-driven models, particularly deep learning models deployed in safety-critical applications.
arXiv Machine Learning
Jul 9
Bound to Disagree: Generalization Bounds via Certifiable Surrogates
arXiv:2602. 23128v2 Announce Type: replace Abstract: Generalization bounds for deep learning models are typically vacuous, not computable or restricted to specific model classes.