arXiv Machine Learning August 26, 2026 By Duy Hoang, Bastien Berret, Olivier Bruneau, Laurent Fribourg

A Data-dependent Early Stopping Rule using Rademacher Complexity with L1-norm

Read the original on arXiv Machine Learning →

The paper proposes an analytic method for determining the optimal early‑stopping time in training neural networks, avoiding the need for gradient‑descent training. It uses Rademacher complexity with an L1‑norm to estimate generalization error, offering a more general approach than previous random‑matrix‑theory based methods. The framework is demonstrated on linear regression and extended to nonlinear neural networks via linear probing, as shown in a MNIST classification example.

Machine-generated by The Flow from the publisher's headline and feed description — not written or checked by a human. The full article lives at arXiv Machine Learning.

Hugging Face Trending Papers

Aug 25

A Data-dependent Early Stopping Rule using Rademacher Complexity with L1-norm

Training neural networks requires balancing the trade-off between fitting the training data and achieving robust performance on unseen inputs. This ability, commonly referred to as generalizability, i...

arXiv Machine Learning

Jul 7

On Regularization via Early Stopping for Least Squares Regression

arXiv:2406. 04425v2 Announce Type: replace Abstract: A fundamental problem in machine learning is understanding the effect of early stopping on the parameters obtained and the generalization capabilities of the model.

By Rishi Sonthalia, Jackie Lok, Elizaveta Rebrova

arXiv Machine Learning

Jun 5

Gradient-Flow Optimization as Dynamic Random-Effects Inference: Testing and Early Stopping with Applications to Deep Learning

arXiv:2605. 27991v2 Announce Type: replace-cross Abstract: Gradient-flow optimization is usually viewed as an algorithmic procedure for minimizing empirical loss, with training duration selected by validation or heuristic early-stopping rules.

By Minhao Yao, Ruoyu Wang, Xihong Lin, Lin Liu, Zhonghua Liu

arXiv Machine Learning

Jul 16

How the Hessian-Spectrum of Neural Networks Depends on Data

arXiv:2607. 13631v1 Announce Type: new Abstract: The Hessian matrix is an important quantity of interest when it comes to studying the loss landscape and optimization dynamics in deep learning, as well as designing measures of generalization, second-order learning algorithms, etc.

By Jasraj Singh, Enea Monzio Compagnoni, Antonio Orvieto

arXiv Machine Learning

Jul 9

Adversarial Rademacher Complexity of Deep Neural Networks

arXiv:2211. 14966v2 Announce Type: replace Abstract: Deep neural networks (DNNs) are highly vulnerable to adversarial attacks.

By Jiancong Xiao, Yanbo Fan, Ruoyu Sun, Zhi-Quan Luo

safety

Hugging Face Trending Papers

Jul 15

How the Hessian-Spectrum of Neural Networks Depends on Data

The Hessian matrix is an important quantity of interest when it comes to studying the loss landscape and optimization dynamics in deep learning, as well as designing measures of generalization, second-order learning algorithms, etc. Prior works have focused on empirical results or pursued a theoretical treatment under overly simplified settings.

One email a morning, machine-written

Related stories

A Data-dependent Early Stopping Rule using Rademacher Complexity with L1-norm

On Regularization via Early Stopping for Least Squares Regression

Gradient-Flow Optimization as Dynamic Random-Effects Inference: Testing and Early Stopping with Applications to Deep Learning

How the Hessian-Spectrum of Neural Networks Depends on Data

Adversarial Rademacher Complexity of Deep Neural Networks

How the Hessian-Spectrum of Neural Networks Depends on Data