arXiv Statistics ML

Online Learning of Functional Principal Component Analysis for Multidimensional Functional Data

The paper introduces an online framework for functional principal component analysis (FPCA) tailored to multidimensional functional data streams. It models functional principal components with tensor product splines, enforcing smoothness and orthonormality via a penalized approach on a Stiefel manifold. The authors present efficient Riemannian stochastic gradient descent and AdaGrad algorithms, along with a dynamic smoothing parameter tuning strategy based on rolling block validation, and provide asymptotic normality results and confidence intervals for the estimators.

arXiv Machine Learning
Jun 16

Functional Gradient Descent with Adaptive Representations

arXiv:2606. 16926v1 Announce Type: cross Abstract: Functional optimization problems are typically solved by optimizing the parameters of a fixed representation, such as a neural network, resulting in highly nonconvex losses that complicate both training and theoretical analysis.

By Daniel Csillag, Rodrigo Schuller, Pedro Dall'Antonia, Leonidas Guibas, Luiz Velho, Tiago Novello
arXiv Statistics ML
Sep 28

Adaptive Subspace Modeling With Functional Tucker Decomposition

The paper introduces a functional Tucker decomposition (FTD) that incorporates a mode-wise continuity constraint into tensor factorization, modeling continuous modes as functions in a reproducing kernel Hilbert space (RKHS) without requiring a predefined basis. It preserves the multilinear subspace structure of the Tucker model and provides a reconstruction error bound for continuous modes, quantifying approximation quality when a subspace estimated on one domain is reused on another. The authors demonstrate the practical value of this subspace transfer on cross-domain classification tasks in hyperspectral imaging and multivariate time-series analysis.

By Noah Steidle, Joppe De Jonghe, Mariya Ishteva
arXiv Machine Learning
Jun 2

Riemannian Optimization for Hadamard Products of Low-Rank Matrices

arXiv:2606. 01216v1 Announce Type: new Abstract: The elementwise Hadamard product of two low-rank matrices provides a parameter-efficient model for data with multiplicative structure, but its modeling is challenging due to the presence of additional symmetries under coupled row/column scalings between the two factors.

By Pratik Jawanpuria, Ankish Chandresh, Bamdev Mishra
arXiv Machine Learning
Aug 6

E$^2$M: Double Bounded $\alpha$-Divergence Optimization for Tensor-based Discrete Density Estimation

arXiv:2405. 18220v4 Announce Type: replace-cross Abstract: Tensor-based discrete density estimation requires flexible modeling and proper divergence criteria to enable effective learning; however, traditional approaches using $\alpha$-divergence face analytical challenges due to the $\alpha$-power terms in the objective function, which hinder the derivation of closed-form update rules.

By Kazu Ghalamkari, Jesper L{\o}ve Hinrich, Morten M{\o}rup