The paper introduces FlexibleFusion, a method for infrared-visible object detection that adapts to both complete and missing-modality scenarios. It employs a Modality-Aware Experts Collaboration mechanism to selectively fuse cross-modal or intra-modal pathways, and a Residual Self-Paced Entropic Optimal Transport module to align heterogeneous feature distributions without heavy optimization. Experiments demonstrate consistent performance across various modality configurations.
By Yue Zhao, Hua Yu, Yukun Zhao, Yuzhi Zhang, Maoguo Gong, Xin Mei, Zhuping Hu, Yanchi Li, A. K. Qin
FoCal is a new frequency‑oriented framework for aerial RGB–IR object detection that explicitly models cross‑modal interaction across different frequency components. It introduces a Frequency‑Aware Dual‑Domain Calibration module to consolidate low‑frequency structural cues while preserving high‑frequency modality‑specific details, and a Discrepancy‑Guided Spectral Modulation module that adaptively enhances, preserves, or attenuates the joint spectrum based on confidence‑weighted amplitude discrepancies. Experiments on DroneVehicle, ESCVehicle, and ATR‑UMOD show FoCal achieving high mAP scores (83.5%, 54.8%, 64.6%) with only 3.0 M parameters and 113.6 FPS, demonstrating a strong accuracy–efficiency trade‑off.
By Ben Liang, Chao Sui, Junqi Bai, Yuan Liu, Chunlai Li, Xiubao Sui, Qian Chen
arXiv:2608.20944v1 Announce Type: new
Abstract: Multimodal object detection in remote sensing faces challenges due to semantic heterogeneity and modality-specific noise interference. To this end, we...
By Xin Wu, Zhenyu Gao, Qiankun Zhang, Shaoyong Guo
Multimodal fusion learning (MFL) has shown great potential in the medical domain, where we are faced with disparate data modalities such as imaging, clinical records, and omics. However, existing MFL strategies face several major challenges.
arXiv:2610.27882v1 Announce Type: new
Abstract: Multispectral object detection requires detectors to exploit material-dependent spectral responses while maintaining consistent localization under geom...
By Peng Zhang, Tingfa Xu, Jinrui Sui, Yuyang Tian, Jianan Li
arXiv:2509.23056v3 Announce Type: replace
Abstract: Remote sensing object detection is a critical technology for real-world applications such as natural resource monitoring, traffic management, and U...
By Ben Liang, Hongguang Wei, Yuan Liu, Bingwen Qiu, Yihong Wang, Xiubao Sui, Qian Chen
arXiv:2607. 08076v1 Announce Type: cross Abstract: The complementary information between RGB and IR images can significantly enhance object detection performance under extreme conditions.
By Wenhao Dong, Xiaoyan Luo, Linlin Yang, Haodong Zhu, Xiaorong Shi, Guodong Guo, Baochang Zhang
arXiv:2608.06205v2 Announce Type: replace
Abstract: Multispectral object detection combines visible and thermal imagery to improve perception under challenging illumination and environmental conditio...
By Nima Hatami, Karim Faez, Saeed Sharifian, Hamidreza Amindavar
Infrared-visible image fusion (IVIF) is pivotal for multimodal perception, yet reconciling the inherent information disparity between thermal and textural features remains a fundamental challenge. Existing prior-guided methods often rely on static constraints that induce optimization conflicts or utilize extrinsic semantic priors from large-scale foundation models (e.
The paper presents M2Heat, a physics-inspired framework for fusing hyperspectral and LiDAR data in land‑cover classification. It introduces a visual heat conduction module (vHeat) and Frequency Value Embeddings (FVEs) to model anisotropic information flow, capturing global dependencies with sub‑quadratic complexity. Combined with a Cross‑Frequency Fusion (CFF) module, M2Heat delivers discriminative, robust features and achieves competitive performance on Trento, Houston2013, and Augsburg benchmarks while offering an interpretable heat‑conduction perspective.
By Kan Wei, Jiahui Cui, Jing Yao, Xinyu Zhao, Lei Wang, Pedram Ghamisi
arXiv:2608. 02092v2 Announce Type: replace Abstract: Deep multimodal fusion for object detection has demonstrated good performance through mining modal characteristics.
By Guandi Wang, Ming Li, Yunsen Xing, Junle Liu
The paper introduces S$^3$F-Net, a dual‑branch network that fuses spatial and spectral representations for medical image classification. It combines a deep spatial CNN with a shallow spectral encoder, SpectraNet, which uses a learnable SpectralFilter layer to process the full Fourier spectrum efficiently. Evaluated on four medical imaging datasets, S$^3$F-Net consistently outperforms spatial‑only baselines, achieving state‑of‑the‑art accuracy on BRISC2025 and surpassing deeper models on the Chest X‑Ray Pneumonia dataset.
By Md. Saiful Bari Siddiqui, Mohammed Imamul Hassan Bhuiyan