arXiv Machine Learning

Neural operators approximate strongly continuous convex monotone semigroups

The paper introduces Chernoff-neural operators, a class of neural operators that can universally approximate Chernoff-type one-step operators for strongly continuous convex monotone semigroups. A universal approximation theorem is proved, and stability estimates in weighted Hölder spaces allow the one-step error to propagate, yielding universal approximation of the entire semigroup. The authors also define envelope-neural operators for envelope semigroups, providing quantitative approximation rates, and demonstrate the approach on numerical examples from nonlinear PDEs, stochastic optimal control, and uncertain stochastic processes.

arXiv Statistics ML
Aug 31

The role of parameter Jacobians in the stability of network outputs

The paper investigates how parameter Jacobians influence the stability of network outputs within the framework of network dynamics, learning models, and neural tangent kernels (NTK). It demonstrates that linearized dynamics can be expressed as a semigroup of linear operators on Hilbert spaces, and provides explicit a priori perturbation bounds for fixed‑kernel linearizations in the NTK setting. The authors also offer refinements for task‑specific spaces, ergodic comparison estimates, spectral‑distribution conditions, and extensions to nonautonomous NTK evolutions, supported by worked examples.

By Halyun Jeong, Palle E. T. Jorgensen, Hyun-Kyoung Kwon, Myung-Sin Song, James Tian