arXiv Machine Learning

Eigenspace-Based Clustering for Personalized System Identification

arXiv Machine Learning
Sep 30

High-Dimensional Partial Least Squares: Spectral Analysis and Fundamental Limitations

The paper investigates Partial Least Squares (PLS) in high-dimensional settings, focusing on a model where two data matrices share a low-rank latent structure plus individual-specific components. By analyzing the singular vectors of the cross‑covariance matrix with random matrix theory, the authors derive asymptotic characterizations of how well the estimated latent directions align with the true ones. They show that the PLS variant based on Singular Value Decomposition (PLS‑SVD) outperforms separate principal component analysis in detecting the common latent subspace, while also identifying regimes where PLS‑SVD behaves counter‑intuitively or reaches fundamental limits.

By Victor L\'eger, Florent Chatelain
arXiv Statistics ML
Sep 18

Robust Multi-Task Learning for Principal Component Analysis

The paper introduces robust multi-task procedures for principal component analysis that leverage similarity across tasks to enhance eigenspace estimation while remaining resilient to outlier tasks. It establishes non-asymptotic convergence rates and demonstrates that the methods achieve minimax optimal performance across various regimes. One procedure, based on matrix-depth, attains optimal error dependence on the proportion of outlier tasks, addressing a key challenge in robust multi-task learning.

By Dali Liu, Haolei Weng
arXiv Machine Learning
Aug 27

Phase-Consistent Magnetic Spectral Learning for Multi-View Clustering

Phase-Consistent Magnetic Spectral Learning for Multi-View Clustering proposes a new unsupervised method that uses a complex-valued magnetic affinity to capture both magnitude and phase information across multiple data views. By deriving a confidence-directed cross-view flow from anchor assignments and combining it with a nonnegative magnitude backbone, the approach constructs a Hermitian magnetic Laplacian that yields a stable shared spectral signal for representation learning and clustering. Experiments on ten public benchmarks show the method outperforms or matches leading MVC baselines on most dataset-metric combinations.

By Mingdong Lu, Zhikui Chen, Meng Liu, Shubin Ma, Zhengyang Tang
arXiv Machine Learning
Jun 5

Anchor PCA

arXiv:2606. 06233v1 Announce Type: cross Abstract: Principal component analysis (PCA) is one of the most widely used unsupervised dimension reduction techniques.

By Benedikt Seiter, Anya Fries, Julius von K\"ugelgen, Jonas Peters