arXiv AI

LVS: Local View Synthesis from Relative Camera Pose by Reusing Previous Views

The paper introduces LVS, a framework that replaces repeated rendering of nearby views in interactive scene exploration with relative‑pose‑guided RGB‑D image reuse. It uses geometric warping based on depth and pose to transport source content, and a lightweight multiscale network to predict RGB residuals that correct artifacts and fill in missing appearance. Cached source features further reduce computation, yielding a 0.72 dB PSNR improvement over pure warping and low query latency on both captured and rendered scenes.

arXiv Computer Vision
Sep 4

Stabilizing Camera-Controlled Novel View Synthesis at Inference Time

The paper introduces CamTrol++, a training‑free method that stabilizes camera‑controlled novel view synthesis from a single image by decomposing large camera motions into small autoregressive steps, thereby limiting per‑step distortion and error accumulation. It also incorporates geometry‑constrained spatial attention, low‑frequency appearance anchoring, and a registration‑free warping pipeline to further enhance stability. Experiments on RealEstate10K and MegaScene demonstrate improved temporal and geometric consistency, better downstream 3D reconstruction quality, and higher generation efficiency, even for long 56‑frame sequences and under depth corruption.

By Prajwal Singh, Arjun Badola, Seema Kumari, Hajime Nagahara, Shanmuganathan Raman
arXiv Computer Vision
Oct 9

LVSPM: Long Sequence View Synthesis and Pose Estimation Model

LVSPM is a generalizable model that jointly estimates camera poses and synthesizes novel views from uncalibrated image collections. It is trained only with RGB images and pose supervision, avoiding dense 3D ground truth, and uses test‑time training layers to scale to hundreds of input views. On datasets such as RealEstate10k, Co3Dv2, and DL3DV, LVSPM outperforms VGGT in pose estimation across 16–256 views and achieves state‑of‑the‑art pose‑free novel view synthesis quality, maintaining high performance even as scene scale increases.

By Xi Chen, Yachi Zhang, Linghao Chen, Minghua Liu, Hao Su, Zexiang Xu, Xiaoshuai Zhang
arXiv AI
6d ago

Aligning Misaligned Benchmarks for Single-View Novel View Synthesis

The paper addresses the lack of standardized evaluation for single‑view novel view synthesis by highlighting the importance of aligning a method’s reference frame with the ground‑truth camera pose. It proposes using traditional 2D‑to‑2D and 2D‑to‑3D image matching to align 3D reconstructions and restricts evaluation to co‑visible regions where a correct ground truth exists. Experiments show that with proper alignment, 3D Gaussian‑based methods reach state‑of‑the‑art performance, and a simple baseline using a video generator and geometry estimator matches specialized novel‑view synthesis models without task‑specific training.

By Yang-Che Tseng, Erqun Dong, Jeong-gi Kwak, Gopal Sharma, Shakiba Kheradmand, Stephan Garbin, Hossam Isack, Kwang Moo Yi
Hugging Face Trending Papers
Aug 11

CasDeblurGS: Cascaded 2D-to-3D Multi-View Consistency for 3D Gaussian Splatting from Two Blurry Images

Free-viewpoint 3D scene media is increasingly important for immersive applications, yet practical capture often suffers from severe view sparsity and motion blur. Although neural rendering has advanced sparse-view synthesis, existing blur-aware methods typically require substantial multi-view redundancy, accurate camera poses, or costly per-scene optimization.

arXiv Computer Vision
Sep 3

RoGe: Novel View Synthesis via End-to-End Implicit Reconstruction and Generation

RoGe is a new end‑to‑end framework for novel view synthesis that jointly learns an implicit 3D scene representation and a video diffusion model. It eliminates the need for explicit 3D intermediates by querying the implicit scene with camera rays to produce geometric features that condition the diffusion model. Experiments on DL3DV show that RoGe surpasses reconstruction‑based, generation‑based, and hybrid baselines in image quality and temporal consistency, and ablations confirm the benefits of ray‑queried features and joint training.

By Xiaolei Lang, Ze Kang, Zehao Huang, Naiyan Wang