Cascaded Non-Line-of-Sight Imaging
Read the original on arXiv Computer Vision →The Flow has not summarised this story yet — read it at arXiv Computer Vision.
The Flow has not summarised this story yet — read it at arXiv Computer Vision.
The paper introduces the Measurement-Adaptive Light-Cone Transform (MALCT), a physics-guided framework that maintains the efficient Fourier-domain inversion of traditional light-cone transform methods while adapting to real-world measurement noise and deviations in non-line-of-sight imaging. MALCT integrates an analytical response with a learned response via measurement-conditioned weighting and predicts a frequency-dependent regularization map within a unified variational formulation. An attention-enhanced spatio-temporal feature extraction module captures long-range temporal dependencies and local spatial correlations, enabling robust reconstruction under low-signal conditions and with reduced acquisition time, as demonstrated on synthetic data and real measurements from various NLOS systems.
The paper introduces a state‑aware framework that reconstructs both foreground and hidden scenes from single‑photon LiDAR histograms affected by partially transmissive occluders. It classifies each ray into no‑return, single‑return, or dual‑return states, guiding a two‑head neural field that jointly refines waveform reconstruction and geometry localization. A new paired dataset of occluded and clean LiDAR captures validates the method, showing improved depth and point‑cloud accuracy over existing baselines.
The paper presents memory‑efficient GPU pipelines that accelerate real‑time non‑line‑of‑sight (NLOS) reconstruction. By redesigning two wave‑based algorithms—f‑k migration and phasor‑fields—with fused kernels, warp‑level photon binning, batched transforms, CUDA graph replay, and selective FP16 storage, the authors achieve up to 42× speed‑ups over a reference streaming pipeline and 14× over the fastest published GPU baseline while reducing memory usage to as little as 2.5%. The work also includes an ablation study of implementation choices and introduces three denoising strategies that leverage the increased frame budget for future NLOS video processing.
Projector-camera (ProCams) systems achieve active scene perception and controllable appearance manipulation via structured illumination, serving as a core infrastructure for spatial augmented reality, projection mapping, and surface reflectance acquisition. Existing inverse-rendering methods for ProCams deliver high-fidelity results but rely on time-consuming per-scene optimization, while mainstream feed-forward 3D reconstruction models produce baked appearance that cannot adapt to spatially varying projector illumination.
arXiv:2608.20602v1 Announce Type: cross Abstract: Many consumer smartphones, stereo cameras, and light field cameras record multiple synchronized viewpoints in a single exposure event. However, novel...
arXiv:2609.22479v1 Announce Type: new Abstract: We address the problem of recovering high-speed videos from dynamic scenes under extreme photon sparsity. Existing methods rely on aggregating photon d...