arXiv Computer Vision

ImprovedVBGS: Real-time Continual Variational Bayes Gaussian Splatting

arXiv Computer Vision
Aug 28

ReSplat: Learning Recurrent Gaussian Splatting

ReSplat introduces a recurrent Gaussian splatting model that iteratively refines 3D Gaussians using the rendering error as a feedback signal, avoiding explicit gradient computation. The method starts from a compact reconstruction in a subsampled space, producing far fewer Gaussians than prior per‑pixel models, which reduces computational cost. Experiments on multiple datasets, view counts, and resolutions show state‑of‑the‑art performance with faster rendering speeds.

By Haofei Xu, Daniel Barath, Andreas Geiger, Marc Pollefeys
arXiv Computer Vision
Sep 4

ReCoSplat: Online Feed-Forward Gaussian Splatting via Render-and-Compare

ReCoSplat is an online feed‑forward Gaussian splatting model that can synthesize novel views from a stream of observations, handling both posed and unposed inputs and optionally using camera intrinsics. It introduces a Render‑and‑Compare module that renders the current scene from the viewpoint of the incoming observation and compares it to the observation, providing a stable conditioning signal to mitigate the mismatch caused by predicted camera poses. A hybrid KV‑cache compression strategy further reduces memory usage, enabling the model to process long sequences efficiently while achieving state‑of‑the‑art performance on online view synthesis tasks.

By Freeman Cheng, Botao Ye, Xueting Li, Junqi You, Fangneng Zhan, Ming-Hsuan Yang
arXiv Computer Vision
Sep 24

Learn2Splat: Extending the Horizon of Learned 3DGS Optimization

arXiv:2605.15760v2 Announce Type: replace Abstract: 3D Gaussian Splatting (3DGS) optimization is most commonly performed using general-purpose first-order optimizers such as Adam or SGD. Although rob...

By Naama Pearl, Stefano Esposito, Haofei Xu, Amit Peleg, Patricia Gschossmann, Lorenzo Porzi, Peter Kontschieder, Gerard Pons-Moll, Andreas Geiger
arXiv Computer Vision
Sep 3

InceptionGS: Generative Bootstrapping for Large-Scale Gaussian Splatting under Unstructured View Sampling

InceptionGS is a method that improves large‑scale Gaussian splatting for scenes captured with unstructured view sampling. It starts from an initial Gaussian splatting and selectively repairs areas affected by sparse views by integrating scene‑ and view‑adaptive generative priors, while keeping well‑covered regions unchanged. Experiments on real‑world scenes show that this hybrid reconstruction‑generation approach yields higher‑fidelity results than existing methods.

By Tianheng Lu, Guangyu Wang, Ruqi Huang, Lu Fang
arXiv Computer Vision
Sep 25

Learning to Navigate with Minimal Parameters: Decomposing Visual Navigation Through Closed-Form Geometric Interfaces

The paper introduces a compact visual navigation system that decomposes the task into three analytically‑computed geometric interfaces and three small learned modules: an egress predictor, a navigation predictor, and an endpoint‑pinned residual diffusion generator. Only 0.58 M of the 23 M parameters are trained on 44 k frames, achieving competitive success rates and the lowest collision rate among evaluated methods across 6 060 point‑goal episodes in 60 environments. The design allows further parameter reduction by replacing the frozen image encoder with a 0.54 M MobileNetV2, supports zero‑shot deployment on a Jetson Orin Nano UGV, and enables transparent failure analysis under sensor corruption.

By Edward Beng Wai Tan, Siew-Kei Lam
arXiv Computer Vision
Sep 3

RoGe: Novel View Synthesis via End-to-End Implicit Reconstruction and Generation

RoGe is a new end‑to‑end framework for novel view synthesis that jointly learns an implicit 3D scene representation and a video diffusion model. It eliminates the need for explicit 3D intermediates by querying the implicit scene with camera rays to produce geometric features that condition the diffusion model. Experiments on DL3DV show that RoGe surpasses reconstruction‑based, generation‑based, and hybrid baselines in image quality and temporal consistency, and ablations confirm the benefits of ray‑queried features and joint training.

By Xiaolei Lang, Ze Kang, Zehao Huang, Naiyan Wang
arXiv Machine Learning
Jul 17

Online Neural Space Time Memory for Dynamic Novel View Synthesis

arXiv:2607. 15271v1 Announce Type: cross Abstract: Online novel view synthesis from multi-view streaming videos faces a fundamental trade-off: maintaining a persistent, long-horizon memory to reconstruct temporarily occluded regions while operating under strict real-time constraints.

By Baback Elmieh, Lynn Tsai, Zeman Li, Srinivas Kaza, Tiancheng Sun, Gabor Csapo, Ali Behrouz, Yuan Deng, Stephen Lombardi, Steven M. Seitz, Xuan Luo
arXiv Computer Vision
6d ago

Reliability-Regulated Trajectory Optimization for Progressive COLMAP-Free 3D Gaussian Splatting

The paper introduces a reliability-regulated trajectory optimization framework for progressive COLMAP‑free 3D Gaussian Splatting (3DGS). It uses a self‑supervised bidirectional cycle‑consistency mechanism to control camera trajectory estimation through forward motion propagation and retrospective trajectory correction, thereby reducing error compounding without external priors. Experiments on Tanks and Temples and CO3D‑V2 demonstrate improved camera trajectory accuracy and novel‑view rendering quality compared to existing unposed baselines.

By Zijian Wu, Jinliang Wang, Zidian Lin, Ying Song, Ziqian Lu, Hanjie Ma, Zhen Ye, Mingfeng Jiang