arXiv Computer Vision

LG-PF: Lightweight Confidence-Guided Polarization Image Fusion

arXiv Computer Vision
Oct 7

PolarScale: A Physics-Grounded Benchmark for Radiometrically Consistent RGB-to-Stokes Estimation

PolarScale is a new benchmark that explicitly requires models to predict the radiometric scale needed for full Stokes reconstruction from a per-scene normalized total‑intensity image. It evaluates models on normalized Stokes components, AoLP/DoLP/DoCP, and a per‑scene scale, using metrics that include angular, self‑consistency, and physical‑bound checks. Across seven restoration‑based and generative backbones, the best restoration models achieve a 3.6‑4.3% mean relative error in scale estimation, outperforming a constant‑scale control and maintaining physical plausibility.

By Beibei Lin, Tingting Chen, Xin Zhang, Wenhao Zhao, Dongjun Li, Zifeng Yuan
arXiv Computer Vision
Oct 19

UniPolar: Joint Image and Polarimetric Restoration under Compound Degradations via Physical Consistency Learning

UniPolar is a new framework for restoring images and polarimetric data from color polarization filter array (CPFA) images that suffer from both device- and environment-induced degradations. It uses two complementary streams to reconstruct four polarization-angle images and predict Stokes difference components, coordinating them with a Degradation Conditioned Cross Domain Interaction module that exchanges frequency-selective evidence and applies condition-adaptive feature correction. The method also enforces physical consistency at the output level, aligning image-derived and directly predicted Stokes components while regularizing angular fidelity and the physical feasibility of degree of linear polarization (DoLP).

By Yang Jin, Guangyu Guo, Linghao Shen, Binglu Wang
arXiv Computer Vision
Sep 28

Learning Polarization Image Restoration with General Restoration Priors

The paper presents an all-in-one framework for restoring polarization images affected by multiple coupled degradations. It identifies the normalized Stokes representation as effective for separating intensity and polarization, and introduces a dual-branch architecture that uses pretrained general restoration priors for the intensity branch while transferring knowledge to the polarization branch via cross-domain feature transform. A composite-degradation benchmark is also established to support future research.

By Chenggong Li, Jinhao Liu, Caiyun Wu, Yidong Luo, Junchao Zhang, Degui Yang
arXiv Computer Vision
Sep 14

RoES: Rotational Equivariant Selective-frequency Fusion for Multimodal Images

RoES is a Rotational Equivariant Selective-frequency fusion network that dynamically separates low- and high-frequency components of infrared-visible images. It uses a trainable rotation-enhanced updater to decouple frequencies, then fuses them with a dual-branch module: a rotation-equivariant Mamba for low-frequency structural dependencies and a polar spectral attention Dual-Fourier block for high-frequency detail refinement. Experiments show RoES outperforms existing methods in fusion quality and downstream object detection, offering a robust multimodal fusion solution.

By Jiabao Wang, Wenjian Liu, Yaoming Cai, Gengyu Zhang, Boyan Zhao, Zijia Zhang, Yao Ding, Xiaobo Liu
arXiv Computer Vision
Sep 14

RA-SOD: Reliability-Aware RGB-T Salient Object Detection under Modality Degradation

RA‑SOD is a new RGB‑Thermal salient object detection framework that explicitly models the reliability of each modality. It introduces a reliability‑conditioned representation, an uncertainty‑guided dual‑stream refinement, and a pixel‑wise modality competition mechanism to adaptively compensate degraded features and suppress unreliable evidence. Experiments on four benchmarks show that RA‑SOD achieves state‑of‑the‑art performance and remains robust under severe modality degradation.

By Hongbo Gao, Zhengyu Li, Xueru Nie, Dihao Zhu, Lijun Zhao, Yunke Wang, Chang Xu
Hugging Face Trending Papers
Aug 13

P2Fusion: Prompt-based Progressive Infrared-Visible Image Fusion via Dual-Prior Distillation

Infrared-visible image fusion (IVIF) is pivotal for multimodal perception, yet reconciling the inherent information disparity between thermal and textural features remains a fundamental challenge. Existing prior-guided methods often rely on static constraints that induce optimization conflicts or utilize extrinsic semantic priors from large-scale foundation models (e.