arXiv Computer Vision

Sparse Light Field Sampling Improves Casual 3D and 4D Reconstruction

arXiv Computer Vision
Oct 28

4D Reconstruction with Events & RGB

The paper presents a lightweight extension to the Monst3R 4D reconstruction model by adding an event-camera input branch while keeping the rest of the architecture unchanged. Across three benchmark datasets, this RGB‑event fusion reduces absolute relative error by an average of 3.4% compared to the RGB‑only baseline, with the largest gains occurring under high object motion where RGB‑only methods falter. The study demonstrates that incorporating event data can meaningfully improve 4D reconstruction robustness without a full architectural redesign.

By Dulanga Weerakoon, Darshana Rathnayake, Van Minh Do, Hemanth Sabbella, Kaichen Zhou, Fangneng Zhan, Alok Prakash, Sanjay E. Sarma, Archan Misra, Paul Pu Liang
arXiv Computer Vision
Sep 3

RoGe: Novel View Synthesis via End-to-End Implicit Reconstruction and Generation

RoGe is a new end‑to‑end framework for novel view synthesis that jointly learns an implicit 3D scene representation and a video diffusion model. It eliminates the need for explicit 3D intermediates by querying the implicit scene with camera rays to produce geometric features that condition the diffusion model. Experiments on DL3DV show that RoGe surpasses reconstruction‑based, generation‑based, and hybrid baselines in image quality and temporal consistency, and ablations confirm the benefits of ray‑queried features and joint training.

By Xiaolei Lang, Ze Kang, Zehao Huang, Naiyan Wang
arXiv AI
Jun 2

A Survey of 3D Reconstruction with Event Cameras

arXiv:2505. 08438v4 Announce Type: replace-cross Abstract: Event cameras are rapidly emerging as powerful vision sensors for 3D reconstruction, uniquely capable of asynchronously capturing per-pixel brightness changes.

By Chuanzhi Xu, Haoxian Zhou, Langyi Chen, Haodong Chen, Zeke Zexi Hu, Zhicheng Lu, Ying Zhou, Vera Chung, Qiang Qu, Weidong Cai
Hugging Face Trending Papers
Aug 11

CasDeblurGS: Cascaded 2D-to-3D Multi-View Consistency for 3D Gaussian Splatting from Two Blurry Images

Free-viewpoint 3D scene media is increasingly important for immersive applications, yet practical capture often suffers from severe view sparsity and motion blur. Although neural rendering has advanced sparse-view synthesis, existing blur-aware methods typically require substantial multi-view redundancy, accurate camera poses, or costly per-scene optimization.

arXiv Computer Vision
Aug 25

GaussVid: Sparse-View Gaussian Splatting with 3D-Aware Video Diffusion Priors

GaussVid introduces a 3D-aware video restoration framework that enhances sparse-view 3D Gaussian Splatting (3DGS) reconstructions. By creating a large-scale 3DGS video dataset and employing a camera-conditioned geometric prior anchored on the first and last frames, the method injects spatial structure into video generation, ensuring geometrically grounded restoration across viewpoints. Experiments demonstrate superior pixel- and structure-level fidelity (PSNR/SSIM) and improved multi-view consistency compared to other video-prior restoration methods, while maintaining competitive perceptual quality (LPIPS).

By Xinhui Liu, Can Wang, Wei Jiang, Wei Wang, Dong Xu
arXiv Computer Vision
Oct 26

CompMVR: Compression-Aware Multi-View Restoration Using Diffusion Models for Geometrically Consistent 3D Reconstruction

arXiv:2610.32800v1 Announce Type: new Abstract: Real-world 3D reconstruction pipelines often rely on multi-view images degraded by lossy compression. While compression artifacts have been extensively...

By Dong-hwi Kim, Chaewon Moon, Hojun Song, Dongbeom Kim, Junyeong Jang, Aro Kim, Gahyeon Kim, Heejung Choi, Jehee Kim, Gianella Cravioto, Sohyun Lee, Gyeongjin Choi, EunHye Jeong, Soo Ye Kim, Jaehyup Lee, Sang-hyo Park
arXiv Computer Vision
Aug 24

GS-Net: Heterogeneous Vehicle Data Reuse via Generalizable Plug-and-Play 3DGS Module

GS‑Net is a lightweight plug‑and‑play module that expands sparse Structure‑from‑Motion point clouds into dense Gaussian primitives, enabling cross‑sensor view synthesis for autonomous driving. It learns a generalizable initialization for 3D Gaussian Splatting, improving rendering quality for both interpolated and extrapolated camera viewpoints. The authors introduce CARLA‑NVS, a benchmark with 12 uniformly spaced cameras, and show that GS‑Net outperforms standard 3DGS by 2.08 dB PSNR on interpolated views and 1.86 dB on extrapolated views while being 50× faster to initialize.

By Yichen Zhang, Zihan Wang, Jiali Han, Peilin Li, Jiaxun Zhang, Jianqiang Wang, Lei He, Keqiang Li