arXiv Machine Learning August 10, 2026 By Zhijun Liu, Dandan Jiang

High-dimensional ridgeless least squares interpolation under spiked covariance structures

Read the original on arXiv Machine Learning →

arXiv:2608. 07281v1 Announce Type: cross Abstract: This paper investigates the asymptotic behavior of the out-of-sample prediction risk of the high-dimensional ridgeless least-squares estimator when the feature dimension $p$ and the sample size $n$ grow proportionally.

Summary generated by The Flow from the publisher's feed. The full article lives at arXiv Machine Learning.

safety

arXiv Machine Learning

Jun 19

Benign overfitting beyond prediction: The ordinary least squares interpolator

arXiv:2309. 15769v3 Announce Type: replace-cross Abstract: Recent advances in deep learning have highlighted the phenomenon of benign overfitting in overparameterized statistical models, sparking significant interest in understanding its foundations.

By Dennis Shen, Dogyoon Song, Peng Ding, Jasjeet S. Sekhon

safety

arXiv Machine Learning

Aug 4

A Simple Approximation to the Distribution of the Ridge Regression Estimator

arXiv:2608. 02539v1 Announce Type: cross Abstract: We present a simple Gaussian approximation to the finite-sample distribution of the classical ridge regression estimator.

By Jos\'e Luis Montiel Olea, Ryan Strong, Amilcar Velez, Zhuoheng Xu, Haomin Yu

safety

arXiv Machine Learning

Jun 10

Risk Comparisons in Linear Regression: Implicit Regularization Dominates Explicit Regularization

arXiv:2509. 17251v2 Announce Type: replace-cross Abstract: Existing theory suggests that for linear regression problems categorized by capacity and source conditions, gradient descent (GD) is always minimax optimal, while both ridge regression and online stochastic gradient descent (SGD) are polynomially suboptimal for certain categories of such problems.

By Jingfeng Wu, Peter L. Bartlett, Sham M. Kakade, Jason D. Lee, Bin Yu

arXiv Machine Learning

Aug 4

The Fourth Quadrant: A Stylized View of Benign Misfitting

arXiv:2608. 01032v1 Announce Type: new Abstract: Training error is what we can observe on a training set; test error is the quantity we actually care about.

By Gireeja Ranade, Anant Sahai

safety

arXiv Machine Learning

Jul 21

Spectral-Transport Stability and Benign Overfitting in Interpolating Learning

arXiv:2604. 08625v2 Announce Type: replace-cross Abstract: We develop a theoretical framework for generalization in the interpolating regime of statistical learning.

By Gustav Olaf Yunus Laitinen-Lundstr\"om Fredriksson-Imanov

safety

arXiv Machine Learning

Jul 28

The Zero Pattern of a Design Matrix Drives Multiple Descent in Over-parameterized Regression

arXiv:2607. 24041v1 Announce Type: cross Abstract: Over-parameterized linear regression has been widely studied over the last decade.

By Kevin Han Huang, Haoyu Ye, Somak Laha, Morgane Austern

Related stories

Benign overfitting beyond prediction: The ordinary least squares interpolator

A Simple Approximation to the Distribution of the Ridge Regression Estimator

Risk Comparisons in Linear Regression: Implicit Regularization Dominates Explicit Regularization

The Fourth Quadrant: A Stylized View of Benign Misfitting

Spectral-Transport Stability and Benign Overfitting in Interpolating Learning

The Zero Pattern of a Design Matrix Drives Multiple Descent in Over-parameterized Regression