arXiv Machine Learning

Beyond ICA: Identifiability by Symmetry Breaking

arXiv:2607. 23182v1 Announce Type: cross Abstract: We prove the identifiability of deep generative models (DGMs) with piecewise-affine (PWA) decoders and Gaussian mixture model (GMM) priors, in a purely unsupervised setting.

arXiv Machine Learning
Jun 30

Robustness and Structure Preservation in Flow-Based Generative Models via Wasserstein Path-Space Divergences

arXiv:2410. 01244v2 Announce Type: replace-cross Abstract: We introduce a novel Wasserstein-1 ($W_1$) path-space divergence for stochastic and deterministic dynamics and establish a Wasserstein Uncertainty Propagation (WUP) theorem that bounds the $W_1$ distance between terminal distributions by the proposed divergence, equivalently characterized by a weighted $L^2$ discrepancy between the underlying drifts and the $W_1$ distance between their initial measures.

By Ziyu Chen, Markos A. Katsoulakis, Benjamin J. Zhang
arXiv Machine Learning
Jun 18

Concept Modulation Models: A Unified Framework for Identifiability and Extrapolation

arXiv:2606. 18509v1 Announce Type: new Abstract: Reliable generalization in conditional latent variable models requires understanding both identifiability and extrapolation: how observed variation across attributes determines latent structure, and how that structure determines distributions at unseen attributes.

By Soheun Yi, Yizhou Lu, Chandler Squires, Pradeep Ravikumar
arXiv Machine Learning
Aug 31

More Data Cannot Break a Symmetry: Identifiability by Design

The paper shows that unsupervised representational alignment can fail due to symmetry in the stimulus geometry, even before data are collected. By using a design-time diagnostic based on the automorphism group of the geometry, the authors demonstrate that dense sampling can create near-duplicates that make alignment degenerate. Applying this diagnostic to a colour design reduces catastrophic alignment failures from 75% to 2% without altering models, layers, or solvers.

By Jing Xu, Christopher Kanan
arXiv Statistics ML
Sep 2

Deep Skew-t Mixture Models

arXiv:2609.00773v1 Announce Type: cross Abstract: High-dimensional clustering is challenging when component distributions are both heavy-tailed and directionally asymmetric. We propose a deep skew-$t...

By Jinran Wu, You-Gan Wang, Geoffrey J. McLachlan