arXiv Machine Learning

Sparse corruption in low-rank matrix inference: the PCA benchmark

arXiv:2511. 11927v2 Announce Type: replace-cross Abstract: Principal Component Analysis (PCA) is a standard tool for extracting a low-rank signal from noisy observations.

arXiv Statistics ML
Sep 24

Rank-One Signal Recovery in Sparse Wishart Noise

arXiv:2609.28163v1 Announce Type: cross Abstract: We study the high-dimensional recovery of a signal vector $\mathbf{x}$ in the presence of sparse Wishart-like noise. We define an $N \times N$ matrix...

By Preben Forer, Urte Adomaityte, Pierpaolo Vivo
arXiv Machine Learning
Sep 23

SuperPCA: subspace analysis and an efficient algorithm for high-dimensional PCA

SuperPCA is a new algorithm for high‑dimensional principal component analysis that exploits an approximate eigenspace of the sample covariance matrix. The authors show that the subspace spanned by several leading eigenvectors contains useful signal information long before individual eigenvectors converge, and they derive posteriori bounds on the angle between this subspace and the true signal subspace. By using only a small number of subsampled coordinates, SuperPCA can achieve up to a ten‑fold improvement in accuracy over classical PCA while reducing data acquisition costs, especially when the signals are approximately sparse.

By Irina-Beatrice Haas, Maike Meier, Yuji Nakatsukasa, Taejun Park
arXiv Machine Learning
Jul 27

Heavy-Tailed Principal Component Analysis

arXiv:2603. 11308v3 Announce Type: replace Abstract: Principal Component Analysis (PCA) is a cornerstone of dimensionality reduction, yet its classical formulation relies critically on second-order moments and is therefore fragile in the presence of heavy-tailed data and impulsive noise.

By Mario Sayde, Christopher Khater, Jihad Fahs, Ibrahim Abou-Faycal
arXiv Machine Learning
Sep 17

Provable Guarantees for Spectral Structured Prediction

The paper presents provable guarantees for a spectral method that recovers binary node labels on signed graphs with edge‑flip noise. It provides graph‑structure‑agnostic bounds on approximate inference accuracy and maximum angle deviation, using matrix concentration and eigenvector perturbation techniques. The results connect to the Cheeger constant and are validated with synthetic experiments, marking the first theoretical analysis of this spectral approach.

By Violet Zheng, Jean Honorio
arXiv Machine Learning
Aug 20

Inference and Uncertainty Quantification for Streaming $r$-PCA

The paper tackles two key gaps in streaming PCA using Oja's algorithm: it establishes sharp operator‑norm convergence for general‑rank subspaces under sub‑Gaussian data, and it provides distributional inference for the resulting subspace estimator. The authors remove non‑vanishing remainder terms from existing analyses, achieving rates that match minimax bounds in both dense‑tail and sparse‑tail regimes. They further develop a linearization of Oja’s iterates, enabling high‑dimensional Gaussian approximations and an online multiplier bootstrap for practical inference.

By Haoshu Xu, Hongzhe Li