arXiv Machine Learning By Ronald Katende

A Learning Stability Profile for Finite-Dimensional Learning Dynamics

Read the original on arXiv Machine Learning →

The paper introduces a finite‑dimensional sensitivity framework called the Learning Stability Profile, which captures how perturbations in inputs, parameter initialization, and update mechanisms propagate along a learning trajectory. It presents a Lyapunov criterion that, under regularity, coercivity, and dissipation assumptions, yields uniform or exponentially decaying bounds on linearized transition operators, distinguishing between terminal decay, boundedness, and subexponential growth. The framework is applied to various learning mechanisms—including feedforward networks, residual architectures, stochastic gradient methods, and locally Lipschitz systems—providing spectral, dissipativity, and contraction‑based stability bounds.

Machine-generated by The Flow from the publisher's headline and feed description — not written or checked by a human. The full article lives at arXiv Machine Learning.

arXiv Statistics ML
Aug 31

The role of parameter Jacobians in the stability of network outputs

The paper investigates how parameter Jacobians influence the stability of network outputs within the framework of network dynamics, learning models, and neural tangent kernels (NTK). It demonstrates that linearized dynamics can be expressed as a semigroup of linear operators on Hilbert spaces, and provides explicit a priori perturbation bounds for fixed‑kernel linearizations in the NTK setting. The authors also offer refinements for task‑specific spaces, ergodic comparison estimates, spectral‑distribution conditions, and extensions to nonautonomous NTK evolutions, supported by worked examples.

By Halyun Jeong, Palle E. T. Jorgensen, Hyun-Kyoung Kwon, Myung-Sin Song, James Tian