arXiv Computer Vision

Learn2Splat: Extending the Horizon of Learned 3DGS Optimization

arXiv AI
6d ago

Spackle: Completing Large View Single Image NVS with Adaptive Gaussians

Spackle is a lightweight residual learning framework designed to improve large-view single-image novel view synthesis (NVS) by mitigating capacity competition in hybrid decoupled systems that combine 3D Gaussian Splatting (3DGS) and diffusion models. It operates in three stages: predicting base 3DGS attributes, automatically identifying poorly reconstructed regions, and learning a residual 3DGS focused on those areas. During inference, Spackle merges the baseline and augmented Gaussians to produce high-fidelity novel views, achieving state‑of‑the‑art performance on large-view-deviation cases.

By Xuanzhi Liu, Yuhe Zhou, Xinyi Wu, Zhenyao Wu, Jinghao Chen, Ruize Han, Song Wang
arXiv Computer Vision
Sep 4

Rethinking 3D Noise: Learning 3D-Aware Video Priors via Optimization-Free Morphological Perturbations

The paper introduces 3D Morphological Perturbations, an optimization‑free regularizer for 3D representations such as NeRF and 3D Gaussian Splatting. By treating each Gaussian as a pixel‑like element, the method applies scale, rotation, and pruning perturbations to preserve spatial consistency across views, eliminating the need for per‑scene optimization during dataset curation. Experiments on a lightweight video diffusion sandbox and a 14B‑parameter video model show that the approach improves geometric priors, reduces mean depth error by 12.5% over state‑of‑the‑art 3D artifact refiners, and boosts downstream robotics policy success rates by up to 8.0% on three manipulation tasks.

By Onat \c{S}ahin, Mohammad Altillawi, George Eskandar, Carlos Carbone, Ziyuan Liu
arXiv AI
Sep 4

TruncGradGS: Improved 3D Gaussian Splatting via Truncated Gradient Updates

The paper introduces TruncGradGS, a piecewise truncated gradient approach that mitigates gradient vanishing in 3D Gaussian Splatting, enhancing optimization stability and robustness to initializations. It demonstrates consistent improvements over random and COLMAP initializations in both static and dynamic settings. Additionally, the authors highlight limitations of existing dynamic scene benchmarks and present a new synthetic dataset for evaluating dynamic Gaussian Splatting.

By Theo Morales, Nhat-Quynh Le-Pham, Robin Atkins, Binh-Son Hua
Hugging Face Trending Papers
Aug 3

StreamSplat: Streaming Feed-Forward 3D Gaussian Splatting

Feed-forward 3D Gaussian Splatting enables efficient novel-view synthesis without per-scene optimization, but most existing methods assume a fixed set of context views and process them jointly. This limits their applicability to online scenarios where calibrated views arrive sequentially and the scene must be updated causally.

Hugging Face Trending Papers
Jul 2

NeoMap: Training-free Novel-View Synthesis from Single Images and Videos

We study the challenging problem of novel view video synthesis from single images or monocular videos. Existing methods, which operate under the assumption that pre-trained video models lack native novel view synthesis capability and enforce view alignment via camera conditioning, task-specific fine-tuning, or stepwise hard denoising guidance, often suffer from artifacts and compromised global scene consistency.

arXiv Computer Vision
Aug 28

ReSplat: Learning Recurrent Gaussian Splatting

ReSplat introduces a recurrent Gaussian splatting model that iteratively refines 3D Gaussians using the rendering error as a feedback signal, avoiding explicit gradient computation. The method starts from a compact reconstruction in a subsampled space, producing far fewer Gaussians than prior per‑pixel models, which reduces computational cost. Experiments on multiple datasets, view counts, and resolutions show state‑of‑the‑art performance with faster rendering speeds.

By Haofei Xu, Daniel Barath, Andreas Geiger, Marc Pollefeys