arXiv Computer Vision

Long-wave Infrared Polarimetric Remote Sensing Image Fusion for Vehicle Detection

arXiv Computer Vision
Sep 14

RoES: Rotational Equivariant Selective-frequency Fusion for Multimodal Images

RoES is a Rotational Equivariant Selective-frequency fusion network that dynamically separates low- and high-frequency components of infrared-visible images. It uses a trainable rotation-enhanced updater to decouple frequencies, then fuses them with a dual-branch module: a rotation-equivariant Mamba for low-frequency structural dependencies and a polar spectral attention Dual-Fourier block for high-frequency detail refinement. Experiments show RoES outperforms existing methods in fusion quality and downstream object detection, offering a robust multimodal fusion solution.

By Jiabao Wang, Wenjian Liu, Yaoming Cai, Gengyu Zhang, Boyan Zhao, Zijia Zhang, Yao Ding, Xiaobo Liu
arXiv Computer Vision
Sep 3

RGB-to-IR image translation for infrared vehicle detection in unseen UAV domains

The paper explores using generative models to translate RGB UAV images into synthetic infrared (IR) images for training vehicle detectors in domains where real IR data is scarce. Various translators—supervised GANs, ControlNet-based diffusion models, and LoRA-ed foundation models—were trained on paired RGB-IR datasets and applied to unseen target datasets to generate synthetic IR data. The synthetic IR images, especially those produced by Stable Diffusion 3.5 with ControlNet, significantly improved detection performance on unseen IR test sets, outperforming RGB and grayscale baselines and narrowing the gap to real IR data.

By Thijs A. Eker, Ella P. Fokkinga, Jan Erik van Woerden, Elfi I. S. Hofmeijer, Sebastiaan P. Snel, Klamer Schutte, Friso G. Heslinga
arXiv Computer Vision
Oct 22

Early versus Late RGB-Infrared Fusion for Counter-UAV Detection: A Comparative Study

This study compares two fusion strategies for UAV detection using RGB and infrared imagery: early (image-level) fusion and late (decision-level) fusion. Extensive testing in varied lighting, backgrounds, distances, altitudes, and zoom levels shows that early fusion yields higher raw performance by integrating thermal data from the start, while late fusion offers a flexible workflow useful when sensors or frames are misaligned. The paper discusses both strengths and weaknesses of each approach and provides practical implementation recommendations.

By Alberto De Zan, Denis Tavaris, Gian Luca Foresti, Ivan Scagnetto
arXiv Computer Vision
1d ago

Navigational Safety of Marine Surface Vehicles in Restricted Visibility: From Intelligent Vision to Vision-Centered Multi-Sensor Fusion

arXiv:2611.05818v1 Announce Type: new Abstract: Marine surface vehicles (MSVs) have attracted considerable attention for their commercial, scientific, and military applications. Owing to their favora...

By Ryan Wen Liu, Fengchuan Song, Tianxiang Wang, Guobei Peng, Youngrong Kim, Xian Zhong, Hooi-Siang Kang, Maohan Liang, Junzhi Yu, Shanliang Yao
arXiv Computer Vision
Sep 11

Toward Interpretable Multimodal Fusion: Heat Conduction Modeling for Hyperspectral and LiDAR Joint Classification

The paper presents M2Heat, a physics-inspired framework for fusing hyperspectral and LiDAR data in land‑cover classification. It introduces a visual heat conduction module (vHeat) and Frequency Value Embeddings (FVEs) to model anisotropic information flow, capturing global dependencies with sub‑quadratic complexity. Combined with a Cross‑Frequency Fusion (CFF) module, M2Heat delivers discriminative, robust features and achieves competitive performance on Trento, Houston2013, and Augsburg benchmarks while offering an interpretable heat‑conduction perspective.

By Kan Wei, Jiahui Cui, Jing Yao, Xinyu Zhao, Lei Wang, Pedram Ghamisi