ODSS-Net introduces a framework for multi‑modal object re‑identification that separates shared structural information from modality‑specific cues. It employs a Shared Structural Feature Construction module to extract modality‑shared structure, an Orthogonal Specific Feature Learning module to isolate identity‑relevant local features, and a Sample Adaptive Mixture of Experts module to fuse these features based on shared structure. Experiments on three benchmarks confirm the effectiveness of this orthogonally decoupled representation learning approach.
Multimodal fusion learning (MFL) has shown great potential in the medical domain, where we are faced with disparate data modalities such as imaging, clinical records, and omics. However, existing MFL strategies face several major challenges.
arXiv:2608. 02092v2 Announce Type: replace Abstract: Deep multimodal fusion for object detection has demonstrated good performance through mining modal characteristics.
arXiv:2609.24539v1 Announce Type: new Abstract: Multi-modal object Re-Identification (ReID) benefits from complementary information across heterogeneous imaging modalities. To further enrich semantic...
Multi-modality data from different sensors provides rich complementary information for 3D perception, becoming an essential component in reliable autonomous driving systems. Current research typically designs intricate and complex fusion strategies to integrate information from multimodal data on a unified bird's-eye-view (BEV) feature map for the joint learning of multiple perception tasks.
The paper introduces an Attention-Driven Complementarity Resampling framework to enhance cross-modality object detection. It employs a shared channel spatial attention mechanism that exchanges semantic masks between modalities, encouraging the backbone to learn generalized features. Additionally, a learnable channel competition module samples and aggregates features channel‑wise, improving robustness and achieving competitive results on multiple datasets.
Visible-Infrared Person Re-Identification (VI-ReID) operates under a closed-world assumption, where queries and galleries are from heterogeneous modalities. However, in open-world scenarios, both sets are likely to contain homogeneous and heterogeneous modality images.
arXiv:2606. 05109v1 Announce Type: new Abstract: To leverage the full potential of multimodal data, we need representations that go beyond the state-of-the-art alignment and fusion approaches and exploit all cross-modal interactions without sacrificing modality-specific information.
The paper introduces FlexibleFusion, a method for infrared-visible object detection that adapts to both complete and missing-modality scenarios. It employs a Modality-Aware Experts Collaboration mechanism to selectively fuse cross-modal or intra-modal pathways, and a Residual Self-Paced Entropic Optimal Transport module to align heterogeneous feature distributions without heavy optimization. Experiments demonstrate consistent performance across various modality configurations.
Visible-infrared person re-identification (VI-ReID) suffers from cross-modal discrepancies and limited discriminative capabilities, leading to suboptimal recognition performance. Current approaches ex...
arXiv:2610.34305v1 Announce Type: new Abstract: Object re-identification requires embeddings that are robust to intra-class variation in viewpoint, illumination, and occlusion, yet preserve sharp sep...
To leverage the full potential of multimodal data, we need representations that go beyond the state-of-the-art alignment and fusion approaches and exploit all cross-modal interactions without sacrificing modality-specific information. Learning disentangled representations is a principled way to identify these underlying shared and unique factors that are hidden in observational data.
arXiv:2609.21522v1 Announce Type: new Abstract: Recent pre-trained foundation models provide rich multi-modal priors for downstream 3D vision tasks. However, the effectiveness of these representation...