arXiv Computer Vision

Compact Snapshot Spectral Imaging with Calibration-Free Aperture Diffraction

The paper introduces ADIS, a compact, cost‑effective, calibration‑free snapshot spectral imaging system that uses only a diffractive lens, a binary mask, and a Bayer‑filtered sensor. ADIS disperses and multiplexes wavelengths, mapping energy to distinct sensor locations, and employs theoretically computed PSFs for calibration‑free spectral reconstruction. The authors further present the Orthogonal Diffraction‑Aware Unfolding Voxel Shift Transformer (ODAUVST) to solve the sparsely‑constrained inverse problem, achieving full‑resolution recovery with reduced parameters and demonstrating superior performance in real SSI experiments.

Hugging Face Trending Papers
Jul 20

FF-ProCams: Feed-Forward Gaussian Splatting for Projector-Camera System

Projector-camera (ProCams) systems achieve active scene perception and controllable appearance manipulation via structured illumination, serving as a core infrastructure for spatial augmented reality, projection mapping, and surface reflectance acquisition. Existing inverse-rendering methods for ProCams deliver high-fidelity results but rely on time-consuming per-scene optimization, while mainstream feed-forward 3D reconstruction models produce baked appearance that cannot adapt to spatially varying projector illumination.

arXiv Computer Vision
Sep 3

SlowFast-SCI: Slow-Fast Deep Unfolding Learning for Spectral Compressive Imaging

SlowFast‑SCI introduces a dual‑speed deep‑unfolding framework for spectral compressive imaging that combines a slow, pre‑trained backbone with a fast, test‑time adaptation stage. The slow phase distills a priors‑based model into a compact fast‑unfolding network, while the fast phase embeds lightweight modules that self‑supervise at test time without retraining the backbone. This design yields significant reductions in parameters and FLOPs, improves out‑of‑distribution PSNR by up to 5.79 dB, and accelerates adaptation four‑fold, all while remaining modular enough to integrate with any existing deep‑unfolding system.

By Haijin Zeng, Xuan Lu, Jiezhang Cao, Kai Zhang, Yurong Zhang, Qiangqiang Shen, Guoqing Chao, Li Jiang, Yongyong Chen, Jingyong Su, Jie Liu
arXiv Computer Vision
Sep 7

Collaborative On-Sensor Array Cameras

The paper presents a collaborative on‑sensor array camera that uses a distributed meta‑optics learning method to jointly optimize a 100‑million‑nanopost metasurface array for broadband visible imaging. By training the array end‑to‑end with a learned meta‑atom proxy and a parallax‑aware, noise‑aware reconstruction algorithm, the design overcomes the wavelength‑dependent limitations of traditional metalenses. Experimental results show that the camera delivers consistent image quality across varying scene illumination spectra without relying on generative reconstruction.

By Jipeng Sun, Kaixuan Wei, Thomas Eboli, Congli Wang, Cheng Zheng, Zhihao Zhou, Arka Majumdar, Wolfgang Heidrich, Felix Heide
arXiv Computer Vision
Sep 7

Learning Spatial-Spectral Refinement and Calibrating Complementary Observations for Hyperspectral Image Super-Resolution

The paper introduces TSR-ITNR, a two‑stage, self‑supervised framework for hyperspectral image super‑resolution that fuses high‑resolution multispectral and low‑resolution hyperspectral data. Stage 1 refines an implicit Tucker representation using a low‑rank spatial tensor and spectral basis, enhanced by a pretrained denoiser, to capture fine spatial details and spectral correlations. Stage 2 applies parameter‑free calibration to extract complementary corrections from both observations, preserving geometry and ensuring orthogonal complementarity, leading to superior reconstruction quality demonstrated on benchmark datasets and improved downstream segmentation performance.

By Liqian Yang, Xingchi Chen, Xinfeng Gui, Xiangyong Cao, Qianxin Yi
arXiv Computer Vision
Aug 31

Memory-efficient GPU pipelines for real-time non-line-of-sight reconstruction

The paper presents memory‑efficient GPU pipelines that accelerate real‑time non‑line‑of‑sight (NLOS) reconstruction. By redesigning two wave‑based algorithms—f‑k migration and phasor‑fields—with fused kernels, warp‑level photon binning, batched transforms, CUDA graph replay, and selective FP16 storage, the authors achieve up to 42× speed‑ups over a reference streaming pipeline and 14× over the fastest published GPU baseline while reducing memory usage to as little as 2.5%. The work also includes an ablation study of implementation choices and introduces three denoising strategies that leverage the increased frame budget for future NLOS video processing.

By Alfonso L\'opez-Ruiz, Diego Royo