The monograph explores the relationships between Gaussian processes and reproducing kernel Hilbert spaces (RKHS), two widely used approaches that rely on positive definite kernels. It examines how these frameworks connect and are equivalent across key topics such as regression, interpolation, numerical integration, distributional discrepancies, statistical dependence, and Gaussian process sample path properties. By establishing a unifying perspective based on the equivalence between the Gaussian Hilbert space and the RKHS, the work aims to bridge methods developed independently by the machine learning, statistics, and numerical analysis communities.
By Motonobu Kanagawa, Philipp Hennig, Dino Sejdinovic, Bharath K. Sriperumbudur
arXiv:2607. 07468v1 Announce Type: cross Abstract: We study the recovery of sparse functions from finite, noisy, and indirect observations in the framework of statistical inverse learning.
By Abhishake Rastogi, Tatiana A. Bubba, Tapio Helin, Luca Ratti
arXiv:2602. 13906v2 Announce Type: replace-cross Abstract: Stochastic approximation (SA) is a method for finding the root of an operator perturbed by noise.
By Shaan Ul Haque, Zedong Wang, Zixuan Zhang, Siva Theja Maguluri
The paper proves global universal approximation theorems for non‑anticipative and general path‑dependent functionals on spaces of piecewise linear paths, showing that linear functionals of the corresponding signatures are dense in $L^p$ and weighted norms. It demonstrates that these results apply to piecewise linear interpolations of Gaussian processes, including Brownian motion and fractional Brownian motion with Hurst parameter $H>1/4$, and provides quantitative convergence rates for signatures of such approximations toward their continuous‑time counterparts. Consequently, the authors obtain $L^p$‑approximation results for path‑dependent functionals of Gaussian processes and for random ordinary and stochastic differential equations driven by Brownian motion.
By Mihriban Ceylan, David J. Pr\"omel
arXiv:2608. 06155v1 Announce Type: cross Abstract: Conditional expectation operators (CEOs) and their associated conditional mean embeddings (CMEs) play a central role across applied mathematics and machine learning, appearing in nonparametric regression, Bayesian inverse problems, and Koopman operator theory.
By Maximiliano Hertel, Ilja Klebanov, Manuel Schaller, Karl Worthmann
We develop a comprehensive theory for regularized M-estimation in reproducing kernel Hilbert spaces. Under mild conditions on the loss we establish existence and measurability of the estimator, covering a wide range of convex and non-convex losses, including bounded robust losses.
arXiv:2610.33286v1 Announce Type: cross
Abstract: Given a random probability distribution \(F\), whose realizations are defined on \(\mathbb R^d\), and a kernel \(k\), our aim is to analyze the prope...
By Amparo Ba\'illo, Mart\'in S\'anchez-Signorini
arXiv:2512. 16396v2 Announce Type: replace-cross Abstract: We establish $L^p$-universal approximation theorems for general path-dependent and non-anticipative functionals on suitable rough path spaces, showing that linear functionals acting on signatures of time-extended rough paths are dense with respect to the $L^p$-distance.
By Mihriban Ceylan, David J. Pr\"omel
arXiv:2507. 07008v2 Announce Type: replace Abstract: Used as priors for Bayesian inverse problems, diffusion models have recently attracted considerable attention in the literature.
By Emile Pierret, Bruno Galerne
The paper investigates how many linear samples are needed to learn Lipschitz operators under Gaussian measures. It establishes both lower and upper bounds on the Hermite polynomial approximation error and shows that the minimal worst‑case error cannot converge algebraically with the number of samples. However, if the covariance operator of the Gaussian measure decays rapidly, convergence rates arbitrarily close to any algebraic rate can be achieved.
By Ben Adcock, Michael Griebel, Gregor Maier
The paper explores the relationship between Gaussian processes and Gaussian random elements within reproducing kernel Banach spaces. It demonstrates that the covariance operator of a weak second‑order Radon probability measure on such a space is uniquely defined by a symmetric positive‑definite function, and in the Gaussian case it identifies which functions correspond to covariance operators via γ‑radonifying operators. Leveraging these findings, the authors extend Driscoll’s theorem to the setting of reproducing kernel Banach spaces.
By Toni Karvonen, Rasmus Kleist H{\o}rlyck S{\o}rensen
arXiv:2606. 07931v1 Announce Type: cross Abstract: We prove a variance-aware pointwise majorizing-measure theorem for centered Gaussian processes.
By Yunbei Xu