arXiv Computer Vision

$\mathbf{R}^3$: Reconstruction, Raw, and Rain: Deraining Directly in the Bayer Domain

arXiv Computer Vision
Sep 3

Benchmarking RAW and RGB Restoration in Image Signal Processors

The paper benchmarks two strategies for blind image restoration around a fixed image signal processor (ISP): restoring in the RAW domain before the ISP (pre‑ISP) and restoring in the sRGB domain after the ISP (post‑ISP). Across four smartphone groups, two learned ISPs, and three degradation regimes (noise, blur, and combined noise‑blur), the study finds that RAW restoration generally outperforms generic RGB restoration, but RGB models trained with ISP‑aware supervision achieve the best overall performance. The authors emphasize that restoration performance depends heavily on how well the restoration model aligns with the imaging pipeline, and they recommend reporting restoration placement and ISP‑aware supervision as key experimental factors.

By Zihao Lu, Radu Timofte, Marcos V. Conde
arXiv Computer Vision
Sep 28

LLPR: Location-aware learning and physics-based reconstruction for raindrop removal from a single image

The paper introduces LLPR, a framework that integrates location-aware learning and physics-based reconstruction to remove raindrops from single images. It replaces costly preprocessing masks with a learnable branch that can be discarded during inference, and reconstructs the background by first estimating a transparency matrix and raindrop layer using a physical model. The authors also present a new real-world dataset and show that LLPR outperforms existing state‑of‑the‑art methods.

By Zewei He, Xingyu Liu, Xing Luo, Guizhong Fu, Zixuan Chen, Yu Chen, Jinlei Li, Zhe-Ming Lu
arXiv Computer Vision
Sep 7

Weather-Conditioned Depth Anything

Weather-Conditioned Depth Anything (DA‑W) is a new framework that enhances monocular depth estimation models, like the Depth Anything series, to perform robustly under adverse weather conditions such as fog, rain, snow, and low‑light. It achieves this by disentangling style from content: a Style Filter extracts weather‑specific embeddings from a curated mix of real and synthetic degradation data, which are then injected into the backbone via a lightweight, zero‑initialized adapter. The adapter is trained with pseudo‑label distillation and alignment, enabling a single unified model to adapt to diverse weather scenarios while preserving its generalization on clean data, and it achieves state‑of‑the‑art performance with an average 3.7% improvement in AbsRel on weather benchmarks.

By Zhaoming Xu, Chan-Wei Hu, Kuan-Ru Huang, Zihao Zhu, Renjie Li, Yang Zhou, Zhengzhong Tu