arXiv Machine Learning

Analytical Standard Errors for Exploratory Factor Solutions

arXiv:1811. 05336v2 Announce Type: replace-cross Abstract: Inference for factor models is often hampered by the lack of tractable and accurate variance estimates, which can materially distort downstream analyses.

Hugging Face Trending Papers
Jul 20

Unveiling Invariant and Transferable Latent Factors Across Heterogeneous Environments via ATLAS

This paper considers a multi-environment factor model in which high-dimensional covariates are collected from heterogeneous environments, with auxiliary labels available in a subset of these environments. The joint distribution of the covariates may vary across environments, whereas the latent structure is decomposed into invariant factors with shared loadings and heterogeneous factors with environment-specific loadings.

arXiv Statistics ML
Aug 25

Sparse Separable Factor Analysis in the Complex Domain with an Application to Local Field Potential Data

The paper introduces Sparse Separable Factor Analysis (SSFA), a latent factor model designed for complex-valued arrays that preserves amplitude and phase information. SSFA models each mode’s covariance with a low‑rank Hermitian factor structure plus a diagonal residual, applying element‑wise lasso penalties to achieve interpretable, phase‑preserving loadings via complex soft‑thresholding. The method is validated through simulations showing improved covariance estimation over vectorization approaches and applied to local field potential data from mice to compare separability across brain region, frequency, and time, as well as to impute missing recordings due to electrode misplacement.

By Ian Hultman, Kirtikanth Kalapatapu, Yassine Filali, Rainbo Hultman, Sanvesh Srivastava
arXiv Machine Learning
Aug 13

A Factor Graph Approach to Scalable Multi-Output Gaussian Process Regression

arXiv:2608. 11917v1 Announce Type: new Abstract: Multi-output Gaussian process regression scales cubically in the number of observations times outputs, and dense kernel-matrix methods need bespoke handling whenever different outputs are observed at different inputs.

By Wouter W. L. Nuijten, Esther G. van Pelt, Albert Podusenko, \.Ismail \c{S}en\"oz, Wouter M. Kouw
arXiv Machine Learning
4d ago

High-Dimensional Partial Least Squares: Spectral Analysis and Fundamental Limitations

The paper investigates Partial Least Squares (PLS) in high-dimensional settings, focusing on a model where two data matrices share a low-rank latent structure plus individual-specific components. By analyzing the singular vectors of the cross‑covariance matrix with random matrix theory, the authors derive asymptotic characterizations of how well the estimated latent directions align with the true ones. They show that the PLS variant based on Singular Value Decomposition (PLS‑SVD) outperforms separate principal component analysis in detecting the common latent subspace, while also identifying regimes where PLS‑SVD behaves counter‑intuitively or reaches fundamental limits.

By Victor L\'eger, Florent Chatelain