arXiv Machine Learning
Mesoscopic learning dynamics of extensive-width neural networks
Read the original on arXiv Machine Learning →The Flow has not summarised this story yet — read it at arXiv Machine Learning.
Related stories
arXiv Machine Learning
Jul 24
Statistical physics of deep learning: Optimal learning of a multi-layer perceptron near interpolation
arXiv:2510. 24616v4 Announce Type: replace-cross Abstract: For four decades statistical physics has been providing a framework to analyse neural networks.
arXiv Machine Learning
Jul 13
How are linear representations learned? Exact solutions to the dynamics of abstraction
arXiv:2607. 08843v1 Announce Type: new Abstract: In artificial and biological neural networks, concepts are often encoded as consistent linear directions in representation space.
arXiv Machine Learning
Aug 11
Weak Correlations as the Underlying Principle for Linearization of Gradient-Based Learning Systems
arXiv:2401. 04013v2 Announce Type: replace Abstract: Deep learning models, such as wide neural networks, can be conceptualized as nonlinear dynamical physical systems characterized by a multitude of interacting degrees of freedom.
arXiv Statistics ML
5d ago
Early learning in large residual networks
arXiv:2610.31783v1 Announce Type: new Abstract: We study the early training dynamics of nonlinear residual networks with blocks of zero hidden layers as a model of more general residual networks. We...
arXiv Machine Learning
Jun 17
A Dynamical Systems Perspective on the Analysis of Neural Networks
arXiv:2507. 05164v2 Announce Type: replace-cross Abstract: In this chapter, we utilize dynamical systems to analyze several aspects of machine learning algorithms.
arXiv Machine Learning
Jul 7
Implicit Bias of SGD in Multivariate ReLU Networks: Effective Width Collapse
arXiv:2607. 03613v1 Announce Type: new Abstract: We study the implicit bias of noisy stochastic gradient descent in training wide two-layer ReLU networks for multivariate regression.