arXiv Computer Vision

Frame-Consistent Feed-Forward 3D Gaussian Splatting from Sparse Unposed Images

arXiv Computer Vision
Oct 9

LVSPM: Long Sequence View Synthesis and Pose Estimation Model

LVSPM is a generalizable model that jointly estimates camera poses and synthesizes novel views from uncalibrated image collections. It is trained only with RGB images and pose supervision, avoiding dense 3D ground truth, and uses test‑time training layers to scale to hundreds of input views. On datasets such as RealEstate10k, Co3Dv2, and DL3DV, LVSPM outperforms VGGT in pose estimation across 16–256 views and achieves state‑of‑the‑art pose‑free novel view synthesis quality, maintaining high performance even as scene scale increases.

By Xi Chen, Yachi Zhang, Linghao Chen, Minghua Liu, Hao Su, Zexiang Xu, Xiaoshuai Zhang
arXiv Computer Vision
4d ago

CrossFit-GS: Out-of-Fold Pose Estimation for COLMAP-Free 3D Gaussian Splatting

CrossFit-GS is a new framework for pose-free 3D Gaussian Splatting that avoids the need for Structure-from-Motion by directly reconstructing scenes from unposed image sequences. The method partitions the input into interleaved subsets, maintaining two complementary submaps and cross-refining candidate poses against a frozen opposite submap to provide an independent geometric reference. Additional checkerboard validation and spatial coverage safeguards reject unreliable updates, and only verified poses are committed; after refinement, the final global representation is trained from scratch using the fixed refined poses, leading to reduced trajectory drift and improved camera pose estimation and novel-view synthesis across multiple benchmarks.

By Zijian Wu, Jinliang Wang, Mingfeng Jiang, Zidian Lin, Ying Song, Ziqian Lu
arXiv Computer Vision
Oct 16

Benchmarking Efficient & Effective Camera Pose Estimation Strategies for Novel View Synthesis

The paper introduces a benchmark for evaluating Structure-from-Motion (SfM) methods used in novel view synthesis (NVS) such as NeRFs and 3DGS. It compares classical SfM, which relies on local feature matches and bundle adjustment, with recent neural network approaches that regress camera parameters directly for faster but less accurate results. The study finds that reducing feature counts speeds up classical SfM without sacrificing pose accuracy, and that combining neural network initial estimates with classical refinement yields the best balance of efficiency and effectiveness.

By Jhacson Meza, Martin R. Oswald, Torsten Sattler
arXiv Computer Vision
Oct 12

NovaSplat: Model-Free 6D Object Pose Estimation via 3D Gaussian Splatting Onboarding and Refinement

NovaSplat is a model‑free pipeline for 6D object pose estimation that builds a 3D Gaussian Splatting (3DGS) model from a short smartphone video during onboarding. The 3DGS model serves both as a template for detection and coarse pose estimation and as a differentiable backbone for pose refinement, which optimizes pose using photometric and geometric losses under a continuous rotation parametrization. The method outperforms all model‑based methods on a household‑object benchmark and all model‑free competitors on a challenging industrial benchmark, while a faster variant, NovaSplat‑Lite, achieves comparable accuracy with a 3.1× speedup.

By Georgios Floros, Evangelos Sartinas, Orestis Vangelis, Maria Pateraki
arXiv Computer Vision
Sep 21

VoxelTTO: Voxel-Aligned Feed-Forward 3D Gaussian Splatting with Test-Time Optimization

VoxelTTO is a feed‑forward framework that reconstructs 3D Gaussian splatting scenes from multiple images by aggregating dense image features into a global voxel representation and decoding Gaussians from voxel features, thereby eliminating the pixel‑to‑Gaussian correspondence. It incorporates test‑time optimization with lightweight LoRA modules to adapt to known camera parameters while keeping the pretrained visual foundation model frozen. The method replaces standard rasterization with stochastic solid volume rendering, improving geometric fidelity, and demonstrates superior RGB‑D novel‑view synthesis and camera‑pose estimation on Replica, Tanks and Temples, and DTU datasets.

By Yibin Zhao, Yihan Pan, Yangwen Li, Jun Nan, Jianjun Yi
arXiv Computer Vision
Sep 3

RoGe: Novel View Synthesis via End-to-End Implicit Reconstruction and Generation

RoGe is a new end‑to‑end framework for novel view synthesis that jointly learns an implicit 3D scene representation and a video diffusion model. It eliminates the need for explicit 3D intermediates by querying the implicit scene with camera rays to produce geometric features that condition the diffusion model. Experiments on DL3DV show that RoGe surpasses reconstruction‑based, generation‑based, and hybrid baselines in image quality and temporal consistency, and ablations confirm the benefits of ray‑queried features and joint training.

By Xiaolei Lang, Ze Kang, Zehao Huang, Naiyan Wang
arXiv Computer Vision
Sep 28

Reliability-Regulated Trajectory Optimization for Progressive COLMAP-Free 3D Gaussian Splatting

The paper introduces a reliability-regulated trajectory optimization framework for progressive COLMAP‑free 3D Gaussian Splatting (3DGS). It uses a self‑supervised bidirectional cycle‑consistency mechanism to control camera trajectory estimation through forward motion propagation and retrospective trajectory correction, thereby reducing error compounding without external priors. Experiments on Tanks and Temples and CO3D‑V2 demonstrate improved camera trajectory accuracy and novel‑view rendering quality compared to existing unposed baselines.

By Zijian Wu, Jinliang Wang, Zidian Lin, Ying Song, Ziqian Lu, Hanjie Ma, Zhen Ye, Mingfeng Jiang
arXiv Computer Vision
Sep 25

One View Is Enough: In-the-Wild Monocular Pretraining for Novel View Generation

The paper introduces OVIE, a monocular novel-view synthesis method that eliminates the need for multi‑view training data. By using a frozen depth estimator to generate pseudo‑target views from single images and applying masked and adversarial losses, OVIE is trained on 30 million uncurated images. It achieves state‑of‑the‑art performance on RealEstate10K and DL3DV, produces highly consistent multi‑view trajectories, and runs at 116 FPS—over 600× faster than the fastest baseline.

By Adrien Ramanana Rahary, Nicolas Dufour, Patrick Perez, David Picard