arXiv Computer Vision

Reliability-Consistent Appearance Modeling for RGB-Infrared Multi-Object Tracking

arXiv Computer Vision
Sep 14

RA-SOD: Reliability-Aware RGB-T Salient Object Detection under Modality Degradation

RA‑SOD is a new RGB‑Thermal salient object detection framework that explicitly models the reliability of each modality. It introduces a reliability‑conditioned representation, an uncertainty‑guided dual‑stream refinement, and a pixel‑wise modality competition mechanism to adaptively compensate degraded features and suppress unreliable evidence. Experiments on four benchmarks show that RA‑SOD achieves state‑of‑the‑art performance and remains robust under severe modality degradation.

By Hongbo Gao, Zhengyu Li, Xueru Nie, Dihao Zhu, Lijun Zhao, Yunke Wang, Chang Xu
arXiv Computer Vision
Sep 30

End-to-End Self-Supervised RGB-T Tracking without Modality Misleading

ESMTrack is a fully end‑to‑end self‑supervised RGB‑T tracking framework that eliminates the need for costly modality‑aligned bounding boxes or offline pseudo‑label generation. It learns discriminative, temporally consistent representations using a grounding triplet loss on the initial annotated frame and a cross‑frame temporal triplet loss on unlabeled search frames, with reliable samples selected via forward‑backward consistency. A three‑branch architecture (fusion, RGB, thermal) and a modality decoupling mechanism mitigate modality dominance bias, enabling competitive state‑of‑the‑art performance, strong cross‑dataset generalization, and real‑time inference on five RGB‑T benchmarks.

By Shenglan Li, Rui Yao, Kunyang Sun, Hong Jia, Yong Zhou, Javen Qinfeng Shi, Xinyu Zhang
arXiv Computer Vision
Oct 12

UniMergeTrack: Hierarchical Model Merging for General RGB-X Visual Object Tracking

UniMergeTrack introduces a hierarchical model merging strategy for RGB-X visual object tracking, combining independently trained modality-specific trackers into a unified framework. The method merges transferable backbones using high‑pass‑filtered merging, aligns tracking heads with optimal transport‑guided channel alignment, and fine‑tunes with distribution alignment to integrate cross‑task knowledge while preserving modality cues. Experiments on multiple benchmarks show state‑of‑the‑art or competitive performance across RGB‑Thermal, RGB‑Event, and RGB‑Depth tracking tasks, with strong generalization to unseen datasets.

By Shiao Wang, Xiao Wang, Yuhe Ding, Jiarui Xu, Zikang Yan, Bo Jiang, Yonghong Tian, Jin Tang
arXiv Computer Vision
5d ago

TriDifNet: A Unified Three-Task Diffusion Network for End-to-End RGB-T Perception

TriDifNet is a diffusion-based network that jointly performs registration, fusion, and detection for misaligned RGB-T pedestrian perception. It includes three modules—RegDM for aligning infrared to visible images, FusDM for generating a detection-oriented fused representation, and DetDM for iterative bounding‑box denoising. The system uses closed‑loop optimization and a Nash‑MTL refinement to balance the three tasks, achieving state‑of‑the‑art detection metrics on the KAIST multispectral benchmark.

By Qianchao He, Jing Liu, Yunhao Li, Xiaoqing Tian
arXiv Computer Vision
5d ago

OmniGlimpse: Asymmetric Identity Memory for Online Multi-View Tracking

OmniGlimpse introduces an asymmetric propose‑verify framework for online multi‑view tracking, separating short‑term adaptive association from long‑term stable identity consolidation. It maps short‑term local and cross‑view evidence into target‑specific adaptive spaces for proposing associations, while maintaining long‑term identity distributions in a canonical space defined by a frozen encoder for verification. The method achieves significant gains over the best online baseline on M3Track and MvMHAT, outperforming offline‑trained references in IDF1 without any offline scene‑specific training.

By Rangya Zhang, Jiaping Xiao, Yujing Shang, Yuhang Zhang, Mingsheng Li, Mir Feroskhan