arXiv Computer Vision

DOD-SA: Infrared-Visible Decoupled Object Detection with Single-Modality Annotations

The paper introduces DOD-SA, a framework for infrared-visible object detection that uses only single-modality annotations. It employs a Collaborative Teacher-Student Network with a single-modality branch and a dual-modality decoupled branch to transfer knowledge across modalities, and a Progressive and Self‑Tuning Training Strategy to refine pseudo‑labels. A Pseudo Label Assigner is also designed to align labels between modalities during training.

arXiv Computer Vision
Sep 17

Aligned Consensus Teaching for Label-Efficient Oriented Object Detection in Weakly-Aligned Visible-Infrared Imagery

The paper introduces Aligned Consensus Teacher (ACT), a semi‑supervised framework for visible‑infrared object detection that operates under an image‑pair‑level setting with only a few labeled pairs. ACT combines Cycle‑Consistent Region Alignment, Cross‑Modal Consensus Mean‑Teacher, and Text‑Guided Cross‑Modal Instance Augmentation to address limited supervision, pseudo‑label errors, and scarce tail‑class annotations. Experiments on DroneVehicle and VEDAI demonstrate that with just 10% labeled pairs, ACT achieves 94.3% of the fully supervised mAP.

By Qi Ming, Xiaxin Yuan, Jiahuan Zhou, Jiangmeng Li, Xudong Zhao, Zhanchao Huang, Juan Fang, Shaoguang Huang, Aleksandra Pizurica
arXiv AI
Sep 2

ADGNet: Asymmetric Dual-text Guided Network for Infrared Small Target Detection

ADGNet introduces an Asymmetric Dual-text Guided Network for infrared small target detection, addressing challenges of pixel-level methods and multimodal approaches that lack regional guidance. It employs an Asymmetric Dual-text Prompt (ADP) with an abstract target prompt and a detailed background prompt, and an Asymmetric Dual-Branch Interaction (ADBI) module to guide visual features separately, followed by an Adaptive Feature Aggregation (AFA) module for dynamic fusion. The authors also create an Asymmetric Image-Text Infrared (AITIR) dataset with asymmetric text annotations for three public datasets, and show that ADGNet outperforms 21 state‑of‑the‑art methods.

By Tongtong Wang, Mingzhu Xu, Chenglong Yu, Jing Wang, Xiaohui Lin, Weili Guan
Hugging Face Trending Papers
Jun 15

FusionRS: A Large-Scale RGB-Infrared Remote Sensing Dataset for Dual-Modal Vision-Language Foundation Models

Remote sensing vision-language models have advanced Earth observation understanding, but most existing work remains centered on RGB imagery, leaving the complementary information in infrared data underexplored. Infrared images provide distinctive cues, including thermal intensity structures, object boundaries, and illumination-invariant scene features, which can enrich visual-language learning beyond conventional RGB observations.

arXiv AI
Jun 16

FusionRS: A Large-Scale RGB-Infrared Remote Sensing Dataset for Dual-Modal Vision-Language Foundation Models

arXiv:2606. 17020v1 Announce Type: cross Abstract: Remote sensing vision-language models have advanced Earth observation understanding, but most existing work remains centered on RGB imagery, leaving the complementary information in infrared data underexplored.

By Jiaju Han, Ben Zhang, Xuemeng Sun, Qike Zhang, Yuxian Dong, Chengyin Hu, Fengyu Zhang, Yiwei Wei, Jiujiang Guo
arXiv Computer Vision
Sep 11

Prototype Matters: Modality-unified Prototype Self-distillation for Unsupervised Visible-infrared Person Re-identification

The paper introduces a new framework for unsupervised visible‑infrared person re‑identification that leverages modality‑unified prototypes. By contrasting with prototypes that unify both modalities, the method jointly optimizes similarity within and across modalities, improving modality invariance. A self‑distillation step refines instance‑prototype relationships using a steady teacher, resulting in a simple yet effective model validated on standard VI‑ReID benchmarks.

By Menglin Wang, Xiaojin Gong
Hugging Face Trending Papers
Aug 13

P2Fusion: Prompt-based Progressive Infrared-Visible Image Fusion via Dual-Prior Distillation

Infrared-visible image fusion (IVIF) is pivotal for multimodal perception, yet reconciling the inherent information disparity between thermal and textural features remains a fundamental challenge. Existing prior-guided methods often rely on static constraints that induce optimization conflicts or utilize extrinsic semantic priors from large-scale foundation models (e.

arXiv Computer Vision
Sep 4

Residual Optimal Transport-Based Experts Collaboration Towards Modality-Aware Infrared-Visible Object Detection

The paper introduces FlexibleFusion, a method for infrared-visible object detection that adapts to both complete and missing-modality scenarios. It employs a Modality-Aware Experts Collaboration mechanism to selectively fuse cross-modal or intra-modal pathways, and a Residual Self-Paced Entropic Optimal Transport module to align heterogeneous feature distributions without heavy optimization. Experiments demonstrate consistent performance across various modality configurations.

By Yue Zhao, Hua Yu, Yukun Zhao, Yuzhi Zhang, Maoguo Gong, Xin Mei, Zhuping Hu, Yanchi Li, A. K. Qin