← Back to all news
arXiv Computer Vision By Qianchao He, Jing Liu, Yunhao Li, Xiaoqing Tian

TriDifNet: A Unified Three-Task Diffusion Network for End-to-End RGB-T Perception

Read the original on arXiv Computer Vision →

TriDifNet is a diffusion-based network that jointly performs registration, fusion, and detection for misaligned RGB-T pedestrian perception. It includes three modules—RegDM for aligning infrared to visible images, FusDM for generating a detection-oriented fused representation, and DetDM for iterative bounding‑box denoising. The system uses closed‑loop optimization and a Nash‑MTL refinement to balance the three tasks, achieving state‑of‑the‑art detection metrics on the KAIST multispectral benchmark.

Machine-generated by The Flow from the publisher's headline and feed description — not written or checked by a human. The full article lives at arXiv Computer Vision.

Related stories

arXiv Computer Vision
Oct 7

Mitigating Illumination-Induced Domain Shift in Night-Time Pedestrian Detection for Intelligent Vehicles using Annotation-Preserving Diffusion Augmentation

The paper introduces Contrastive‑SDXL, a day‑to‑night augmentation framework that uses SDXL‑Turbo and Low‑Rank Adaptation to generate realistic night‑time images for pedestrian detection. It employs a patch‑wise semantic contrastive loss guided by a pretrained DINOv2 encoder and an object consistency loss to preserve pedestrian and local semantic structure during translation, achieving a FID of 22.5. Detectors trained on these synthetic images show a 6‑7% reduction in miss rate compared to a daytime‑only baseline, approaching the performance of models trained on real night‑time data.

By Franky George, Muhammad Khalid, Adil Khan, Koorosh Aslansefat
diffusionfine-tuningsafety
More like this →
arXiv Computer Vision
Sep 21

XCalib Depth-Guided Geometric Optimization for Dense Thermal-Visible Video Registration

XCalib is an unsupervised dense registration framework that aligns thermal and visible video streams by optimizing virtual pinhole camera parameters and predicted monocular depth, thereby restricting spatial displacements to physically valid projection geometries. It introduces a novel registration paradigm using camera parameterization as an implicit regularizer, a robust Normalized Edges Correlation (NEC) metric for cross‑spectral alignment, and demonstrates superior temporal stability and alignment accuracy on public ADAS datasets compared to unconstrained dense flow baselines.

By Aurelien Godet, Gabriel Jobert, Mauro Dalla Mura
computer-visionmultimodalsafety
More like this →
arXiv Computer Vision
Sep 4

Residual Optimal Transport-Based Experts Collaboration Towards Modality-Aware Infrared-Visible Object Detection

The paper introduces FlexibleFusion, a method for infrared-visible object detection that adapts to both complete and missing-modality scenarios. It employs a Modality-Aware Experts Collaboration mechanism to selectively fuse cross-modal or intra-modal pathways, and a Residual Self-Paced Entropic Optimal Transport module to align heterogeneous feature distributions without heavy optimization. Experiments demonstrate consistent performance across various modality configurations.

By Yue Zhao, Hua Yu, Yukun Zhao, Yuzhi Zhang, Maoguo Gong, Xin Mei, Zhuping Hu, Yanchi Li, A. K. Qin
computer-visionefficiencymultimodalsafety
More like this →