arXiv Statistics ML

Wasserstein approximation of measures via orthogonal frames: statistical and computational complexities

arXiv:2610. 36581v1 Announce Type: cross Abstract: Dimension-reduction methods such as PCA identify a subspace capturing most of the variation in the data, but not a distinguished basis within it.

Hugging Face Trending Papers
Oct 21

Lifting PCA in the Wasserstein Space

Principal Component Analysis (PCA) is a fundamental tool for statistical dimension reduction, yet no canonical extension to distribution-valued data has emerged within the framework of optimal transpo...

arXiv Machine Learning
Oct 12

Linearized Wasserstein dimensionality reduction with approximation guarantees

The paper introduces LOT Wassmap, an algorithm designed to uncover low‑dimensional structures in the Wasserstein space without computing a full pairwise distance matrix. It leverages approximation schemes such as Sinkhorn distances and linearized optimal transport to accelerate computations, and provides theoretical guarantees on embedding quality even when only finite samples are available. Experiments show that LOT Wassmap achieves accurate embeddings that improve with larger sample sizes while significantly reducing computational cost compared to traditional pairwise‑distance‑based methods.

By Alexander Cloninger, Keaton Hamm, Varun Khurana, Caroline Moosm\"uller
arXiv Machine Learning
Oct 22

Lifting PCA in the Wasserstein Space

The paper introduces Lifted PCA, a canonical extension of Euclidean PCA to the Wasserstein space of probability measures. By lifting variational formulations on the Stiefel and Grassmann manifolds, the authors derive equivalent minimization problems over probability measures that correspond to Wasserstein barycenters with generalized costs. The work establishes dual formulations, optimality conditions, connections to multimarginal optimal transport, statistical consistency, and computational algorithms, and demonstrates practical performance on distributional datasets.

By J\'er\'emie Bigot, Cl\'ement Bonet
arXiv Machine Learning
Jun 30

Learning from samples: inverse problems over measures

arXiv:2505. 07124v3 Announce Type: replace Abstract: We study inverse problems where an unknown potential is observed only through samples from the measure it induces by a convex variational principle.

By Francisco Andrade, Gabriel Peyr\'e, Clarice Poon
arXiv Machine Learning
Jun 2

Robust Learning of a Group DRO Neuron

arXiv:2601. 18115v2 Announce Type: replace Abstract: We study the problem of learning a single neuron under standard squared loss in the presence of arbitrary label noise and group-level distributional shifts, for a broad family of covariate distributions.

By Guyang Cao, Shuyao Li, Sushrut Karmalkar, Jelena Diakonikolas
arXiv Machine Learning
Sep 30

Learning Distributionally Robust First-Order Methods for Convex Optimization

The paper introduces a distributionally robust method for learning hyperparameters of first‑order convex optimization algorithms. By minimizing a Wasserstein‑robust performance estimation problem over a dataset of problem instances, the approach interpolates between classical learning‑to‑optimize (L2O) and worst‑case PEP design. The authors solve the resulting problem with stochastic gradient descent, provide high‑probability risk bounds, and demonstrate that the learned algorithms outperform both worst‑case optimal and vanilla L2O baselines on logistic regression, LASSO, and linear programming tasks.

By Vinit Ranjan, Jisun Park, Bartolomeo Stellato
arXiv Machine Learning
Oct 23

Random Projections for Spectral Algorithms: Optimal Rates in Sobolev Norms

The paper studies random projections (RP) for spectral algorithms, providing a comprehensive analysis of their generalization performance under broad conditions. By exploiting the RKHS embedding property and operator similarity, it establishes optimal learning rates in Sobolev norms that match minimax lower bounds up to logarithmic factors. For common RP implementations—randomized sketches and Nyström sub-sampling—the required projection dimension scales with the effective dimension, reducing computational cost while preserving statistical efficiency.

By Caixing Wang, Yue Wang