Deep Multimodal Fusion Detection through Spatial Mask and Channel Fusion
arXiv:2608. 02092v2 Announce Type: replace Abstract: Deep multimodal fusion for object detection has demonstrated good performance through mining modal characteristics.
arXiv:2608. 02092v2 Announce Type: replace Abstract: Deep multimodal fusion for object detection has demonstrated good performance through mining modal characteristics.
The paper introduces an Attention-Driven Complementarity Resampling framework to enhance cross-modality object detection. It employs a shared channel spatial attention mechanism that exchanges semantic masks between modalities, encouraging the backbone to learn generalized features. Additionally, a learnable channel competition module samples and aggregates features channel‑wise, improving robustness and achieving competitive results on multiple datasets.
The paper introduces a new framework for unsupervised visible‑infrared person re‑identification that leverages modality‑unified prototypes. By contrasting with prototypes that unify both modalities, the method jointly optimizes similarity within and across modalities, improving modality invariance. A self‑distillation step refines instance‑prototype relationships using a steady teacher, resulting in a simple yet effective model validated on standard VI‑ReID benchmarks.
arXiv:2608.06205v2 Announce Type: replace Abstract: Multispectral object detection combines visible and thermal imagery to improve perception under challenging illumination and environmental conditio...
arXiv:2609.21522v1 Announce Type: new Abstract: Recent pre-trained foundation models provide rich multi-modal priors for downstream 3D vision tasks. However, the effectiveness of these representation...
Visible-Infrared Person Re-Identification (VI-ReID) operates under a closed-world assumption, where queries and galleries are from heterogeneous modalities. However, in open-world scenarios, both sets are likely to contain homogeneous and heterogeneous modality images.
arXiv:2609.14419v1 Announce Type: cross Abstract: Person re-identification (ReID) is essential for multi-camera surveillance and tracking, yet remains difficult due to viewpoint and illumination chan...
Multimodal fusion learning (MFL) has shown great potential in the medical domain, where we are faced with disparate data modalities such as imaging, clinical records, and omics. However, existing MFL strategies face several major challenges.
arXiv:2607. 16338v1 Announce Type: cross Abstract: This article presents DMFNet, a dual-backbone multiscale feature fusion framework with residual feature propagation and spatial attention for remote sensing scene classification.
arXiv:2608.23503v1 Announce Type: new Abstract: Text-based person anomaly search requires distinguishing individuals based on fine-grained, context-dependent behaviors rather than mere appearance. Ex...
arXiv:2610.07928v1 Announce Type: cross Abstract: Dynamic multimodal learning aims to learn robust representations by adaptively modeling information discrepancies across modalities. However, existin...
The paper introduces NWPU-Refer, the largest bilingual dataset for referring remote sensing image segmentation, featuring 15,003 high‑resolution images from over 30 countries and 49,745 annotated targets. It also proposes the Multi‑scale Referring Segmentation Network (MRSNet), which uses an Intra‑scale Feature Interaction Module to refine fine‑grained features and a Hierarchical Feature Interaction Module to fuse cross‑scale information while preserving spatial structure. Experiments on NWPU‑Refer and RRSIS‑D show that MRSNet achieves strong, competitive performance, especially under strict IoU thresholds, demonstrating the effectiveness of both the new dataset and the model.