arXiv Machine Learning

Diagonal Attenuation: A Finite-Sample Correction for PCA

arXiv Machine Learning
Jul 27

Heavy-Tailed Principal Component Analysis

arXiv:2603. 11308v3 Announce Type: replace Abstract: Principal Component Analysis (PCA) is a cornerstone of dimensionality reduction, yet its classical formulation relies critically on second-order moments and is therefore fragile in the presence of heavy-tailed data and impulsive noise.

By Mario Sayde, Christopher Khater, Jihad Fahs, Ibrahim Abou-Faycal
arXiv Machine Learning
Aug 28

When Is the Sharp Covariance Envelope Tight? Feature-Only Geometry for Volume-Sampled Least Squares

The paper extends prior work on volume sampling by providing a Loewner envelope for the centered coefficient covariance in least‑squares regression with a fixed pool of features and responses. It characterizes when this envelope is tight, linking tightness to strict spectral properties of residuals, and introduces a residual‑augmented change of measure to derive a one‑sided slack bound. The results also offer geometric insights at the boundary and demonstrate non‑vacuous certificates through frozen‑feature examples, focusing on conditional centered, full‑Gram‑whitened covariance rather than population generalization.

By Kihun Rhee