arXiv Computer Vision

A Gradient-Regularized Deep Learning Method for Restoring Image in Myopic Vision

arXiv Machine Learning
Jun 3

Towards Blind Lens Aberration Correction via Large LensLib Pre-training and Discrete Degradation Priors

arXiv:2511. 17126v4 Announce Type: replace-cross Abstract: Emerging deep-learning-based lens library pre-training (LensLib-PT) pipeline offers a new avenue for blind lens aberration correction by training a universal neural network, demonstrating strong capability in handling diverse unknown optical degradations.

By Xiaolong Qian, Qi Jiang, Yao Gao, Lei Sun, Kailun Yang, Xian Wang, Zhonghua Yi, Wenyong Li, Ming-Hsuan Yang, Luc Van Gool, Kaiwei Wang
arXiv Computer Vision
Sep 15

Restore What Matters: Lessons from Joint Restoration and Recognition

arXiv:2609.13791v1 Announce Type: new Abstract: Recognition pipelines typically adopt a restore-then-recognize workflow, yet decades of experience show that generating visually pleasing images seldom...

By Lanqing Guo, Xijun Wang, Minchul Kim, Yu Yuan, Wes Robbins, Xingguang Zhang, Nicholas Chimitt, Stanley H. Chan, Zhangyang Wang, Xiaoming Liu
arXiv Computer Vision
Aug 21

Unwarping the Lens: A Physics-Grounded Approach to Video Glasses Removal

arXiv:2608. 20212v1 Announce Type: new Abstract: High-fidelity removal of eyeglasses from video is a major challenge in facial attribute editing, as the underlying facial geometry is often obscured by complex refractive distortions and view-dependent specular reflections.

By Radim Spetlik, David Futschik, Radek Danecek, Feitong Tan, Ziqian Bai, Rohit Pandey, Yinda Zhang
arXiv Computer Vision
Sep 3

Evaluating Fundus-Specific Foundation Models for Diabetic Macular Edema Detection

The study evaluates fundus-specific foundation models (FM) for detecting diabetic macular edema (DME) in retinal images. It compares two popular FM—RETFound and FLAIR—against a lightweight EfficientNet-B0 backbone across multiple datasets (IDRiD, MESSIDOR-2, and OCT-and-Eye-FundusImages). Results indicate that FM do not consistently outperform fine‑tuned CNNs; EfficientNet-B0 often matches or exceeds FM performance, with FLAIR being the most competitive FM.

By Franco Javier Arellano, Jos\'e Ignacio Orlando
arXiv Computer Vision
Sep 23

NaCR: Visual Localization via NeRF-aided Camera Ray Regression

NaCR: Visual Localization via NeRF-aided Camera Ray Regression proposes a unified framework that integrates Neural Radiance Fields (NeRF) with Camera Ray Regression (CRR) to improve visual localization accuracy. The method enhances the CRR baseline with three simple improvements, augments training data by synthesizing novel views from a pre‑trained NeRF, and employs a closed‑loop supervision pipeline that back‑propagates photometric rendering errors to refine predicted camera rays. A two‑stage training curriculum ensures stable convergence, and experiments on indoor and outdoor benchmarks show competitive accuracy with validated component efficacy.

By Yesheng Zhang, Xiang Dai, Xu Zhao, Chongyang Zhang
arXiv Computer Vision
Aug 31

From Perspective to Fisheye Depth Estimation and Open-Vocabulary Segmentation

The paper introduces Distortion Extenders (DEX), learnable parameters that adapt vision foundation models to fisheye cameras by modeling distortion coefficients and correcting distributional shifts between fisheye and perspective images. DEX is applied to monocular depth estimation and open‑vocabulary segmentation across convolutional and Transformer architectures, consistently outperforming baselines on indoor and outdoor fisheye datasets. Additionally, DEX activations can be decoded to obtain distortion coefficients, aiding camera calibration.

By Rit Gangopadhyay, Alex Wong
arXiv AI
Oct 12

Understanding Transformer-based Vision Models through Inversion

The paper revisits feature inversion via inverse networks, proposing a modular variant that is computationally efficient and can produce more semantically coherent image reconstructions. It applies this method to large‑scale transformer‑based vision models—Detection Transformer, Vision Transformer, Swin Transformer, and Data‑Efficient Image Transformer—examining reconstructions across network depth. The analysis highlights gradual representational changes in Detection and Vision Transformers, systematic differences in preserving contextual shape and fine‑grained details, and varying robustness to color perturbations, while also demonstrating the framework’s broader applicability to other transformer architectures.

By Jan Rathjens, Shirin Reyhanian, David Kappel, Laurenz Wiskott