arXiv Machine Learning July 27, 2026 By Jean Barbier, Francesco Camilli, Minh-Toan Nguyen, Mauro Pastore, Rudy Skerk

Optimal generalisation and learning transition in extensive-width shallow neural networks near interpolation

Read the original on arXiv Machine Learning →

arXiv:2501. 18530v3 Announce Type: replace-cross Abstract: We consider a teacher-student model of supervised learning with a fully-trained two-layer neural network whose width $k$ and input dimension $d$ are large and proportional.

Summary generated by The Flow from the publisher's feed. The full article lives at arXiv Machine Learning.

safety

arXiv Machine Learning

Jul 27

Statistical mechanics of extensive-width Bayesian neural networks near interpolation

arXiv:2505. 24849v2 Announce Type: replace-cross Abstract: For three decades statistical mechanics has been providing a framework to analyse neural networks.

By Jean Barbier, Francesco Camilli, Minh-Toan Nguyen, Mauro Pastore, Rudy Skerk

arXiv Machine Learning

Jul 24

Statistical physics of deep learning: Optimal learning of a multi-layer perceptron near interpolation

arXiv:2510. 24616v4 Announce Type: replace-cross Abstract: For four decades statistical physics has been providing a framework to analyse neural networks.

By Jean Barbier, Francesco Camilli, Minh-Toan Nguyen, Mauro Pastore, Rudy Skerk

rag

arXiv AI

Jun 29

How Width and Data Shape Generalization Scaling Laws in Quadratic Neural Networks

arXiv:2606. 28242v1 Announce Type: cross Abstract: Understanding how performance scales jointly with model size and data is a central problem in modern machine learning.

By Julius Girardin, Emanuele Troiani, Yizhou Xu, Vittorio Erba, Florent Krzakala, Lenka Zdeborov\'a

arXiv Machine Learning

Jun 30

Favorability of Loss Landscape with Weight Decay Requires Both Large Overparametrization and Initialization

arXiv:2505. 22578v2 Announce Type: replace Abstract: The optimization of neural networks under weight decay remains poorly understood from a theoretical standpoint.

By Etienne Boursier, Matthew Bowditch, Matthias Englert, Ranko Lazic

arXiv Machine Learning

Jun 2

Balancing Learning Rates Across Layers: Exact Two-Step Dynamics and Optimal Scaling in Linear Neural Networks

arXiv:2606. 00340v1 Announce Type: new Abstract: We study optimal learning-rate selection in two-layer and three-layer linear neural networks trained to learn linear target functions.

By Tianyu Pang, Vignesh Kothapalli, Shenyang Deng, Haohui Wang, Dawei Zhou, Yaoqing Yang

arXiv Machine Learning

Jul 30

On the robustness of noisy solutions in non-convex neural networks

arXiv:2607. 27000v1 Announce Type: cross Abstract: Optimization in non-convex neural network models is strongly influenced by the geometry of the solution space: sparse, isolated, point-like clusters are typically algorithmically inaccessible, whereas wide and flat regions can be found efficiently despite being relatively rare.

By Enrico M. Malatesta, Alessandra Passalacqua, Riccardo Zecchina

Related stories

Statistical mechanics of extensive-width Bayesian neural networks near interpolation

Statistical physics of deep learning: Optimal learning of a multi-layer perceptron near interpolation

How Width and Data Shape Generalization Scaling Laws in Quadratic Neural Networks

Favorability of Loss Landscape with Weight Decay Requires Both Large Overparametrization and Initialization

Balancing Learning Rates Across Layers: Exact Two-Step Dynamics and Optimal Scaling in Linear Neural Networks

On the robustness of noisy solutions in non-convex neural networks