arXiv Machine Learning

Local Fr\'echet functional regression in manifolds from time-correlated bivariate curve data

arXiv:2505. 05168v4 Announce Type: replace-cross Abstract: Under mild conditions, a least-squares local linear Fr\'echet curve predictor is derived for a response and a regressor evaluated in a separable Hilbert space.

arXiv Machine Learning
Aug 18

Iso-Riemannian Optimization on Learned Data Manifolds

arXiv:2510. 21033v3 Announce Type: replace-cross Abstract: We develop a theory of iso-Riemannian optimization for problems constrained to learned data manifolds, a setting in which classical Riemannian optimization - and Riemannian gradient descent in particular - can be poorly suited.

By Willem Diepeveen, Melanie Weber
arXiv Machine Learning
Sep 21

Riemannian Simultaneous Inference for Tangent Vector Field Regression

The paper develops a nonparametric kernel estimator for tangent vector field regression on a Riemannian manifold without boundary, using parallel transport to align responses before averaging. It derives uniform bias, covariance, and stochastic rates, and constructs a simultaneous confidence tube by whitening the tangent norm into a unit‑variance Gaussian field, whose Gumbel limit yields an explicit intrinsic constant. The method is validated through simulations on various manifolds and applied to reconstruct global wind data, demonstrating spatially varying uncertainty.

By Xiaotian Chang, Yangdi Jiang, Qirui Hu
arXiv Statistics ML
Sep 4

Online Learning of Functional Principal Component Analysis for Multidimensional Functional Data

The paper introduces an online framework for functional principal component analysis (FPCA) tailored to multidimensional functional data streams. It models functional principal components with tensor product splines, enforcing smoothness and orthonormality via a penalized approach on a Stiefel manifold. The authors present efficient Riemannian stochastic gradient descent and AdaGrad algorithms, along with a dynamic smoothing parameter tuning strategy based on rolling block validation, and provide asymptotic normality results and confidence intervals for the estimators.

By Muye Nanshan, Nan Zhang, Jiguo Cao
arXiv Machine Learning
Jun 9

Generalization in Nonlinear Least Squares via Learned Feature Geometry

arXiv:2606. 08799v1 Announce Type: cross Abstract: We study the generalization of ridge-regularized nonlinear least-squares models via on-average algorithmic stability, deriving error bounds for local minimizers in terms of a data-dependent effective dimension that reflects the geometry of the gradient model at the trained parameters, through the empirical Jacobian Gram matrix and a residual--curvature term.

By Ayub Kharel, Ilja Kuzborski, Patrick Rebeschini, Yasin Abbasi-Yadkori
arXiv Machine Learning
Jul 14

Riemannian Denoising Diffusion Probabilistic Models

arXiv:2505. 04338v3 Announce Type: replace Abstract: We propose Riemannian Denoising Diffusion Probabilistic Models (RDDPMs) for learning distributions on submanifolds of Euclidean space that are level sets of functions, including most of the manifolds relevant to applications.

By Zichen Liu, Wei Zhang, Christof Sch\"utte, Tiejun Li