arXiv Computer Vision
Sep 14

RoES: Rotational Equivariant Selective-frequency Fusion for Multimodal Images

RoES is a Rotational Equivariant Selective-frequency fusion network that dynamically separates low- and high-frequency components of infrared-visible images. It uses a trainable rotation-enhanced updater to decouple frequencies, then fuses them with a dual-branch module: a rotation-equivariant Mamba for low-frequency structural dependencies and a polar spectral attention Dual-Fourier block for high-frequency detail refinement. Experiments show RoES outperforms existing methods in fusion quality and downstream object detection, offering a robust multimodal fusion solution.

By Jiabao Wang, Wenjian Liu, Yaoming Cai, Gengyu Zhang, Boyan Zhao, Zijia Zhang, Yao Ding, Xiaobo Liu
arXiv Computer Vision
Sep 3

RGB-to-IR image translation for infrared vehicle detection in unseen UAV domains

The paper explores using generative models to translate RGB UAV images into synthetic infrared (IR) images for training vehicle detectors in domains where real IR data is scarce. Various translators—supervised GANs, ControlNet-based diffusion models, and LoRA-ed foundation models—were trained on paired RGB-IR datasets and applied to unseen target datasets to generate synthetic IR data. The synthetic IR images, especially those produced by Stable Diffusion 3.5 with ControlNet, significantly improved detection performance on unseen IR test sets, outperforming RGB and grayscale baselines and narrowing the gap to real IR data.

By Thijs A. Eker, Ella P. Fokkinga, Jan Erik van Woerden, Elfi I. S. Hofmeijer, Sebastiaan P. Snel, Klamer Schutte, Friso G. Heslinga
arXiv Computer Vision
Oct 22

Early versus Late RGB-Infrared Fusion for Counter-UAV Detection: A Comparative Study

This study compares two fusion strategies for UAV detection using RGB and infrared imagery: early (image-level) fusion and late (decision-level) fusion. Extensive testing in varied lighting, backgrounds, distances, altitudes, and zoom levels shows that early fusion yields higher raw performance by integrating thermal data from the start, while late fusion offers a flexible workflow useful when sensors or frames are misaligned. The paper discusses both strengths and weaknesses of each approach and provides practical implementation recommendations.

By Alberto De Zan, Denis Tavaris, Gian Luca Foresti, Ivan Scagnetto