The paper introduces Multi-task Disentangling Fusion Mamba (MDF-Mamba), a framework for spectral-temporal unmixing of MODIS time series. It uses a disentangling architecture that pairs per-channel spectral experts with a bidirectional Mamba temporal branch, and integrates their outputs via a manifold-constrained hyper-connection (mHCFusion). The method also models endmember variability with pixel-wise learnable weights and employs a multi-task training objective combining supervised abundance estimation, self-supervised spectral reconstruction, and endmember regularization, achieving top performance on most evaluation metrics for Alberta and Saskatchewan datasets.
Spectral-temporal unmixing of MODIS time series is essential for applications such as abundance mapping and spectral library construction, yet it remains challenging due to (i) spectral-temporal infor...
The paper introduces variational decomposition autoencoding (VDA), a framework that biases signal decomposition into latent representations. VDA is realized as variational decomposition autoencoders (DecVAEs), encoder-only networks that learn multiple latent subspaces aligned with time‑frequency characteristics. Experiments on simulated data and three speech datasets show that DecVAEs outperform traditional VAEs in disentanglement quality and robustness, producing factor‑specific latent subspaces when generative factors have distinct spectral signatures.
arXiv:2608. 08207v1 Announce Type: cross Abstract: Multivariate Time Series Classification (MTSC) demands models that can effectively capture complex temporal patterns across multiple scales while remaining computationally efficient.
InfMasking introduces a unified multimodal learning framework that uses Infinite Masking to encourage fusion modules to capture synergistic information across modalities. By randomly masking modality features before fusion and enforcing consistency with an unmasked reference, the method discourages reliance on dominant or shared signals and promotes meaningful cross‑modal interactions. The approach models masked fused representations as Gaussian, optimizing closed‑form variational bounds, and demonstrates improved predictive performance and higher synergy metrics on benchmark datasets.
arXiv:2610.27883v1 Announce Type: new Abstract: Multispectral aerial object detection aims to exploit spectral-spatial cues to address object detection challenges in complex aerial scenes. Existing m...
arXiv:2606.08906v2 Announce Type: replace Abstract: In many binary segmentation tasks, most multimodal methods rely on fixed feature concatenation for cross-modal interaction and straightforward deco...
arXiv:2608. 02769v1 Announce Type: cross Abstract: Multimodal supervised learning seeks to leverage multiple heterogeneous data sources to improve predictive performance.
Multispectral aerial object detection aims to exploit spectral-spatial cues to address object detection challenges in complex aerial scenes. Existing methods mainly focus on spectral-spatial decouplin...
The paper introduces MIDAPN, a unified spatiotemporal forecasting backbone that integrates media-general graph adaptation and automatic temporal learning for both multivariate and multimodal time series. It employs a Multimedia Identity-Aware Graph to capture static, dynamic, and latent relationships across media, and a Spectral Prism Convolution for hierarchical temporal analysis. Extensive experiments on 13 multivariate and 12 multimodal datasets show MIDAPN consistently outperforms 16 state‑of‑the‑art TSF models and is compatible with various foundation models.
arXiv:2606. 11190v1 Announce Type: new Abstract: Cross-modal alignment (CA) and cross-modal prediction (CP) are the dominant paradigms for multimodal representation learning, yet there is no systematic understanding of when each succeeds, when each fails, and when cross-modal training helps at all -- a gap that leaves practitioners, especially in scientific domains like biomedicine or astrophysics, with heterogeneous instruments and multiple levels of organization and measurement, unable to diagnose why standard methods underperform the best single modality.
The paper presents an agentic framework that uses a large vision‑language model to refine hyperspectral unmixing results from existing modular pipelines. By iteratively gathering spectral and spatial evidence through tools such as spectral‑library retrieval and abundance‑map visualization, the agent merges or discards endmembers and re‑estimates abundances. Experiments on HYDICE Urban, Jasper Ridge, and Stonewall Playa datasets show consistent improvements in endmember cardinality and overall decomposition quality across multiple pipelines, while remaining competitive with end‑to‑end methods.
arXiv:2604. 09787v2 Announce Type: replace-cross Abstract: Data collected from the physical world is always a combination of multiple sources: an underlying signal from the physical process of interest and a signal from measurement-dependent artifacts from the sensor or instrument.