arXiv Machine Learning
Landau theory of quenched criticality in linear in-context learning
Read the original on arXiv Machine Learning →The Flow has not summarised this story yet — read it at arXiv Machine Learning.
Related stories
arXiv Machine Learning
Aug 11
From Objectives to What Models Learn: A Landau Theory of Invariant Learning
arXiv:2608. 09396v1 Announce Type: new Abstract: Invariant learning seeks representations that remain predictive across environments, yet the behavior of its objectives along the regularization path is often opaque.
Hugging Face Trending Papers
Aug 10
From Objectives to What Models Learn: A Landau Theory of Invariant Learning
Invariant learning seeks representations that remain predictive across environments, yet the behavior of its objectives along the regularization path is often opaque. We address this objective-behavior gap by viewing representation learning as multimode magnetization and deriving, from concrete invariant-learning objectives, a Landau-type effective free energy whose low-order coefficients form objective signatures and induce distinct regularization phenotypes.
arXiv Machine Learning
Jul 30
On the robustness of noisy solutions in non-convex neural networks
arXiv:2607. 27000v1 Announce Type: cross Abstract: Optimization in non-convex neural network models is strongly influenced by the geometry of the solution space: sparse, isolated, point-like clusters are typically algorithmically inaccessible, whereas wide and flat regions can be found efficiently despite being relatively rare.
arXiv Machine Learning
Aug 31
Learning between the peaks: sharp asymptotics for kernel ridge regression under power-law anisotropy
arXiv:2608. 28564v1 Announce Type: cross Abstract: We study kernel ridge regression under anisotropic Gaussian data, where the input covariance decays as a power law with exponent $\alpha\geq 0$ for polynomial inner-product kernels.
arXiv Machine Learning
Sep 10
High-Magnetization Sampling at Low Temperatures: Ising Models and Bayesian Sparse Linear Regression
arXiv:2609.08873v1 Announce Type: cross Abstract: Sparsity is a powerful structural resource in optimization and statistics. We develop frameworks for leveraging sparsity in sampling problems over th...
arXiv Machine Learning
Aug 10
Cascading Through the Hierarchy: Regularizer-Induced Feature Detection as Phase Transitions in Deep Linear Neural Networks
arXiv:2608. 06597v1 Announce Type: cross Abstract: A scientific theory of deep learning, comprising learning dynamics and statistical properties of learned models, is rapidly gaining attention.