arXiv Machine Learning

Efficient Approximation for Encoder--Decoder Neural Operators via Variation Spaces

arXiv:2606. 01244v1 Announce Type: cross Abstract: We study operator learning using encoder--decoder neural networks.

arXiv Machine Learning
Jul 16

New universal operator approximation theorem for encoder-decoder architectures

arXiv:2503. 24092v2 Announce Type: replace-cross Abstract: Motivated by the rapidly growing field of mathematics for operator approximation with neural networks, we present a novel universal operator approximation theorem for broad classes of encoder-decoder architectures and a wide range of input and output spaces.

By Janek G\"odeke, Pascal Fernsel
arXiv Machine Learning
Sep 15

Resolution-Independent Analysis of Encoder--Decoder Operator Learning via Limiting Kernels

The paper studies operator learning on function spaces using encoder–decoder architectures. It shows that as input and output resolutions grow, the induced kernels converge to a limiting kernel, enabling regularity assumptions independent of resolution. The authors derive upper and lower bounds for regularized stochastic gradient descent, extend the analysis to neural networks via the limiting neural tangent kernel, and provide error bounds and complexity guarantees for various kernel and encoding constructions.

By Lei Shi, Jia-Qi Yang, Ding-Xuan Zhou
arXiv Machine Learning
Aug 18

Operator-Theoretic Generalization Bounds for Multitask Deep Learning

arXiv:2608. 15982v1 Announce Type: new Abstract: We develop operator-theoretic generalization bounds for deep multi-output function classes by representing network layers as Koopman composition operators on vector-valued reproducing kernel Hilbert spaces.

By Mahdi Mohammadigohari, Thomas Borsani, Giuseppe Di Fatta
Hugging Face Trending Papers
Aug 17

Operator-Theoretic Generalization Bounds for Multitask Deep Learning

We develop operator-theoretic generalization bounds for deep multi-output function classes by representing network layers as Koopman composition operators on vector-valued reproducing kernel Hilbert spaces. In vector-valued Sobolev RKHSs, we derive Rademacher complexity bounds for invertible and width-expanding injective architectures.

arXiv AI
Sep 2

Universal Approximation of Nonlinear Operators and Their Derivatives

The paper establishes the first Universal Approximation Theorems for k‑times differentiable nonlinear operators and their derivatives in general Banach spaces, extending classical results to infinite‑dimensional settings. It introduces Derivative‑Informed Operator Learning (DIOL) and formulates Bastiani–Sobolev training for this framework, covering architectures such as DeepONets, Deep‑H‑ONets, and PCA‑Nets. The work also outlines applications to high‑order accuracy in operator learning, constrained optimization in Banach spaces, and numerical methods for infinite‑dimensional PDEs.

By Filippo de Feo
arXiv Machine Learning
Sep 15

Neural Operators for Nonlinear Functionals on RKHS

arXiv:2403.12187v2 Announce Type: replace-cross Abstract: Motivated by the abundance of functional data, such as time series and images, we study the approximation and statistical learning of nonline...

By Tian-Yi Zhou, Namjoon Suh, Guang Cheng, Xiaoming Huo