arXiv Computer Vision

DensePol: Dense-Angle Polarization Dataset for Learning-Based Polarimetric Vision

arXiv Computer Vision
Oct 19

UniPolar: Joint Image and Polarimetric Restoration under Compound Degradations via Physical Consistency Learning

UniPolar is a new framework for restoring images and polarimetric data from color polarization filter array (CPFA) images that suffer from both device- and environment-induced degradations. It uses two complementary streams to reconstruct four polarization-angle images and predict Stokes difference components, coordinating them with a Degradation Conditioned Cross Domain Interaction module that exchanges frequency-selective evidence and applies condition-adaptive feature correction. The method also enforces physical consistency at the output level, aligning image-derived and directly predicted Stokes components while regularizing angular fidelity and the physical feasibility of degree of linear polarization (DoLP).

By Yang Jin, Guangyu Guo, Linghao Shen, Binglu Wang
arXiv Computer Vision
Oct 7

PolarScale: A Physics-Grounded Benchmark for Radiometrically Consistent RGB-to-Stokes Estimation

PolarScale is a new benchmark that explicitly requires models to predict the radiometric scale needed for full Stokes reconstruction from a per-scene normalized total‑intensity image. It evaluates models on normalized Stokes components, AoLP/DoLP/DoCP, and a per‑scene scale, using metrics that include angular, self‑consistency, and physical‑bound checks. Across seven restoration‑based and generative backbones, the best restoration models achieve a 3.6‑4.3% mean relative error in scale estimation, outperforming a constant‑scale control and maintaining physical plausibility.

By Beibei Lin, Tingting Chen, Xin Zhang, Wenhao Zhao, Dongjun Li, Zifeng Yuan
arXiv Computer Vision
Sep 28

Learning Polarization Image Restoration with General Restoration Priors

The paper presents an all-in-one framework for restoring polarization images affected by multiple coupled degradations. It identifies the normalized Stokes representation as effective for separating intensity and polarization, and introduces a dual-branch architecture that uses pretrained general restoration priors for the intensity branch while transferring knowledge to the polarization branch via cross-domain feature transform. A composite-degradation benchmark is also established to support future research.

By Chenggong Li, Jinhao Liu, Caiyun Wu, Yidong Luo, Junchao Zhang, Degui Yang
arXiv Computer Vision
Sep 23

NaCR: Visual Localization via NeRF-aided Camera Ray Regression

NaCR: Visual Localization via NeRF-aided Camera Ray Regression proposes a unified framework that integrates Neural Radiance Fields (NeRF) with Camera Ray Regression (CRR) to improve visual localization accuracy. The method enhances the CRR baseline with three simple improvements, augments training data by synthesizing novel views from a pre‑trained NeRF, and employs a closed‑loop supervision pipeline that back‑propagates photometric rendering errors to refine predicted camera rays. A two‑stage training curriculum ensures stable convergence, and experiments on indoor and outdoor benchmarks show competitive accuracy with validated component efficacy.

By Yesheng Zhang, Xiang Dai, Xu Zhao, Chongyang Zhang
arXiv Computer Vision
Sep 7

Learning Spatial-Spectral Refinement and Calibrating Complementary Observations for Hyperspectral Image Super-Resolution

The paper introduces TSR-ITNR, a two‑stage, self‑supervised framework for hyperspectral image super‑resolution that fuses high‑resolution multispectral and low‑resolution hyperspectral data. Stage 1 refines an implicit Tucker representation using a low‑rank spatial tensor and spectral basis, enhanced by a pretrained denoiser, to capture fine spatial details and spectral correlations. Stage 2 applies parameter‑free calibration to extract complementary corrections from both observations, preserving geometry and ensuring orthogonal complementarity, leading to superior reconstruction quality demonstrated on benchmark datasets and improved downstream segmentation performance.

By Liqian Yang, Xingchi Chen, Xinfeng Gui, Xiangyong Cao, Qianxin Yi
arXiv Computer Vision
Oct 16

Monotone Piecewise-Linear Harmonization of Multitemporal Multispectral Surface Reflectance With Unsupervised Deep Multiview Pseudoinvariant Features Learning

The paper introduces Deep Multitemporal Generalized Canonical Correlation Analysis (DeepMGCCA), an unsupervised deep multiview framework that learns deep pseudoinvariant features (DIFs) to harmonize surface reflectance from optical satellite imagery across different dates. By replacing linear projections with a shared convolutional encoder and employing iterative reweighting and a reconstruction regularizer, the method preserves genuine temporal variability while removing systematic biases. Experiments on Landsat‑8/9 and Sentinel‑2 data show that a monotone piecewise‑linear transform based on DIF quantiles reduces between‑date spectral angle by up to 2.54, RMSE by 0.015, and increases PSNR by up to 4.04 dB, demonstrating effective bias removal.

By Lino Garda Denaro, Chia-Hsiang Lin