arXiv AI

Perspectives on Latent Factor Indeterminacy and its Implications for Data Representation

arXiv:2606. 28854v1 Announce Type: cross Abstract: The common factor analytic model is related to Helmholtz and Boltzmann machines, can be conceived as a linear autoencoder, or can be thought of as a single-hidden-layer generative neural network.

arXiv Statistics ML
Aug 25

Neuro-Causal Factor Analysis

Neuro-Causal Factor Analysis (NCFA) reimagines traditional factor analysis by integrating causal structure learning and deep generative modeling. The method learns a directed graph linking latent and observed variables, then trains a deep generative model that respects the graph’s Markov factorization. Experiments on synthetic and real datasets show NCFA achieves lower reconstruction error than standard FA and better latent distribution recovery than a variational autoencoder, while offering a sparser architecture, reduced complexity, and causal interpretability.

By Alex Markham, Mingyu Liu, Bryon Aragam, Liam Solus
arXiv Machine Learning
Aug 11

A solvable high-dimensional model where nonlinear autoencoders learn structure invisible to PCA while test loss misaligns with generalization

arXiv:2602. 10680v2 Announce Type: replace-cross Abstract: Many real-world datasets contain hidden structure that cannot be detected by simple linear correlations between input features.

By Vicente Conde Mendes, Lorenzo Bardone, C\'edric Koller, Jorge Medina Moreira, Vittorio Erba, Emanuele Troiani, Lenka Zdeborov\'a