arXiv:2608. 07385v1 Announce Type: cross Abstract: Learning disentangled representations is a key requirement for developing versatile, general-purpose, and sustainable models in multi-modal wearable computing.
By Ioannis Ziogas, Ensieh Khazaei, Bilal Taha, Aamna Al Shehhi, Ahsan H. Khandoker, Leontios J. Hadjileontiadis, Dimitrios Hatzinakos
The paper investigates when supervised learning can recover the true latent variables that generate data, focusing on two causal settings: generative (labels cause latents) and discriminative (latents cause labels). It shows that if the representation space has at least as many dimensions as the latent space, optimal encoders are linear; otherwise, identifiability fails and encoders become nonlinear. Additional constraints—such as non‑negative activations in the generative case or sparsity and spark conditions in the discriminative case—enable recovery of individual latent variables, linking nonlinear ICA, compressed sensing, and neural network interpretability.
By Junze Zhou, David Klindt
arXiv:2606. 09725v1 Announce Type: new Abstract: Disentanglement, the separation of factors of variation in data using neural networks, remains a long-standing challenge in machine learning.
By Jhonny J. Velasquez Olivera, Christo K. Thomas, Walid Saad
arXiv:2511. 13899v2 Announce Type: replace-cross Abstract: Low-rank recurrent neural networks (lrRNNs) are a class of models that uncover low-dimensional latent dynamics underlying neural population activity.
By Chengrui Li, Yunmiao Wang, Yule Wang, Weihan Li, Dieter Jaeger, Anqi Wu
The paper introduces Multi-task Disentangling Fusion Mamba (MDF-Mamba), a framework for spectral-temporal unmixing of MODIS time series. It uses a disentangling architecture that pairs per-channel spectral experts with a bidirectional Mamba temporal branch, and integrates their outputs via a manifold-constrained hyper-connection (mHCFusion). The method also models endmember variability with pixel-wise learnable weights and employs a multi-task training objective combining supervised abundance estimation, self-supervised spectral reconstruction, and endmember regularization, achieving top performance on most evaluation metrics for Alberta and Saskatchewan datasets.
By Motasem Alkayid, Yimin Zhu, Naser El-Sheimy, Lincoln Linlin Xu
arXiv:2408. 15344v2 Announce Type: replace Abstract: Many scientific and engineering problems involve observing a common phenomenon through multiple heterogeneous sensors or measurement modalities.
By George A. Kevrekidis, Eleni D. Koronaki, Dimitris G. Giovanis, Yannis G. Kevrekidis