arXiv:2606. 01244v2 Announce Type: replace-cross Abstract: Inspired by the function-space theory of neural networks, we formulate and analyze a variation space for nonlinear operators between Hilbert spaces, defined through vector-valued Borel measures of bounded variation.
By Jia-Qi Yang, Lei Shi
arXiv:2503. 24092v2 Announce Type: replace-cross Abstract: Motivated by the rapidly growing field of mathematics for operator approximation with neural networks, we present a novel universal operator approximation theorem for broad classes of encoder-decoder architectures and a wide range of input and output spaces.
By Janek G\"odeke, Pascal Fernsel
The paper studies operator learning on function spaces using encoder–decoder architectures. It shows that as input and output resolutions grow, the induced kernels converge to a limiting kernel, enabling regularity assumptions independent of resolution. The authors derive upper and lower bounds for regularized stochastic gradient descent, extend the analysis to neural networks via the limiting neural tangent kernel, and provide error bounds and complexity guarantees for various kernel and encoding constructions.
By Lei Shi, Jia-Qi Yang, Ding-Xuan Zhou
arXiv:2608. 15982v1 Announce Type: new Abstract: We develop operator-theoretic generalization bounds for deep multi-output function classes by representing network layers as Koopman composition operators on vector-valued reproducing kernel Hilbert spaces.
By Mahdi Mohammadigohari, Thomas Borsani, Giuseppe Di Fatta
arXiv:2609.15355v1 Announce Type: cross
Abstract: We study the uniform approximation of smooth scalar-valued functionals on an infinite-dimensional separable Hilbert space by deep ReLU neural network...
By Shuhao Jiao
We develop operator-theoretic generalization bounds for deep multi-output function classes by representing network layers as Koopman composition operators on vector-valued reproducing kernel Hilbert spaces. In vector-valued Sobolev RKHSs, we derive Rademacher complexity bounds for invertible and width-expanding injective architectures.
arXiv:2608. 11479v1 Announce Type: new Abstract: We establish convergence guarantees of gradient descent for general feedforward neural networks of arbitrary width or depth, with no special requirements on the initialization or dataset.
By Siqiao Mu, Diego Klabjan
arXiv:2606. 17419v1 Announce Type: new Abstract: We develop approximation and generalization error estimates for multi-input neural operators, with the output error measured in Sobolev norms.
By Yahong Yang, Zecheng Zhang, Wei Zhu, Wenjing Liao, Hao Liu
arXiv:2609.15355v2 Announce Type: replace-cross
Abstract: We study the uniform approximation of smooth scalar-valued functionals on an infinite-dimensional separable Hilbert space by ReLU neural netw...
By Shuhao Jiao
The paper establishes the first Universal Approximation Theorems for k‑times differentiable nonlinear operators and their derivatives in general Banach spaces, extending classical results to infinite‑dimensional settings. It introduces Derivative‑Informed Operator Learning (DIOL) and formulates Bastiani–Sobolev training for this framework, covering architectures such as DeepONets, Deep‑H‑ONets, and PCA‑Nets. The work also outlines applications to high‑order accuracy in operator learning, constrained optimization in Banach spaces, and numerical methods for infinite‑dimensional PDEs.
By Filippo de Feo
arXiv:2606. 14954v1 Announce Type: cross Abstract: We develop a general framework for analyzing representation costs of parametric data-fitting methods through their parameter-space regularizers.
By Greg Ongie, Rahul Parhi
arXiv:2403.12187v2 Announce Type: replace-cross
Abstract: Motivated by the abundance of functional data, such as time series and images, we study the approximation and statistical learning of nonline...
By Tian-Yi Zhou, Namjoon Suh, Guang Cheng, Xiaoming Huo