arXiv Computer Vision

VGGT-Diff: Visual Geometry Meets Diffusion for Sparse-View Novel View Synthesis

arXiv Computer Vision
Sep 3

RoGe: Novel View Synthesis via End-to-End Implicit Reconstruction and Generation

RoGe is a new end‑to‑end framework for novel view synthesis that jointly learns an implicit 3D scene representation and a video diffusion model. It eliminates the need for explicit 3D intermediates by querying the implicit scene with camera rays to produce geometric features that condition the diffusion model. Experiments on DL3DV show that RoGe surpasses reconstruction‑based, generation‑based, and hybrid baselines in image quality and temporal consistency, and ablations confirm the benefits of ray‑queried features and joint training.

By Xiaolei Lang, Ze Kang, Zehao Huang, Naiyan Wang
Hugging Face Trending Papers
Jun 24

PRISM: Feed-Forward Single-Image 3D Reconstruction via Geometric Warp-Residual Modeling

Reconstructing 3D scenes from a single image is a fundamental challenge in computer vision, with broad applications in virtual reality, robotics, and content creation. Recent methods achieve outstanding performance by leveraging camera-controlled video diffusion models, but rely on iterative diffusion sampling, which greatly limits their practical deployment.

arXiv Computer Vision
Aug 25

GaussVid: Sparse-View Gaussian Splatting with 3D-Aware Video Diffusion Priors

GaussVid introduces a 3D-aware video restoration framework that enhances sparse-view 3D Gaussian Splatting (3DGS) reconstructions. By creating a large-scale 3DGS video dataset and employing a camera-conditioned geometric prior anchored on the first and last frames, the method injects spatial structure into video generation, ensuring geometrically grounded restoration across viewpoints. Experiments demonstrate superior pixel- and structure-level fidelity (PSNR/SSIM) and improved multi-view consistency compared to other video-prior restoration methods, while maintaining competitive perceptual quality (LPIPS).

By Xinhui Liu, Can Wang, Wei Jiang, Wei Wang, Dong Xu
arXiv Computer Vision
Oct 9

LEGO: A Lifting-Free Approach for Exocentric-to-Egocentric Video Generation

The paper introduces LEGO, a lifting‑free method for generating egocentric videos from a single exocentric recording. Instead of reconstructing depth and point clouds, it trains a transformer‑based view synthesizer that directly predicts the egocentric view, providing a probabilistic correspondence map that balances structural alignment with texture averaging. This approach outperforms existing explicit pipelines and generalizes across datasets without retraining.

By Suhwan Cho, Yonwoo Choi, Soongjin Kim, Jicheol Park, Taegyu Lim
arXiv Computer Vision
Sep 21

4DGS-Fixer: Generative Sparse-View 4D Gaussian Splatting with Iterative Refinement Guided by Video Diffusion Priors

The paper introduces 4DGS-Fixer, an iterative refinement framework that uses a video diffusion model to enhance sparse-view 4D Gaussian Splatting for dynamic scene synthesis. It first fuses multi-view depth maps into dense point clouds for better geometric initialization, then applies a pretrained video restoration model to refine rendered sequences, providing pseudo-supervision for further refinement. Experiments on a benchmark dataset show the method outperforms existing baselines, achieving nearly a 2 dB PSNR improvement.

By Haitao Huang, Shenghao Zhao, Boyuan Tian, Shin-Fang Chng, Songlin Yang, Sheila Lim, Huangying Zhan, Yi Xu, Anyi Rao, Frank Guan