arXiv Computer Vision

D3GS: Depth, DINO, and RGB Diffusion Co-Guided 3D Gaussian Splatting for Sparse-View Reconstruction

arXiv Computer Vision
Sep 4

F4Splat: Feed-Forward Predictive Densification for Feed-Forward 3D Gaussian Splatting

F4Splat introduces a feed‑forward predictive densification strategy for 3D Gaussian splatting that allocates Gaussians based on a densification‑score guided by spatial complexity and multi‑view overlap. The method predicts per‑region scores to estimate required Gaussian density, enabling explicit control over the total Gaussian budget without retraining. This adaptive allocation reduces redundancy in simple regions and minimizes duplicate Gaussians across overlapping views, yielding compact yet high‑quality 3D representations and superior novel‑view synthesis performance with fewer Gaussians.

By Injae Kim, Chaehyeon Kim, Minseong Bae, Minseok Joo, Hyunwoo J. Kim
arXiv AI
Sep 28

Spackle: Completing Large View Single Image NVS with Adaptive Gaussians

Spackle is a lightweight residual learning framework designed to improve large-view single-image novel view synthesis (NVS) by mitigating capacity competition in hybrid decoupled systems that combine 3D Gaussian Splatting (3DGS) and diffusion models. It operates in three stages: predicting base 3DGS attributes, automatically identifying poorly reconstructed regions, and learning a residual 3DGS focused on those areas. During inference, Spackle merges the baseline and augmented Gaussians to produce high-fidelity novel views, achieving state‑of‑the‑art performance on large-view-deviation cases.

By Xuanzhi Liu, Yuhe Zhou, Xinyi Wu, Zhenyao Wu, Jinghao Chen, Ruize Han, Song Wang
arXiv Computer Vision
Oct 12

CompactSplat: Spatially Adaptive Gaussian Distribution for Feedforward Scene Reconstruction

CompactSplat introduces a feedforward scene reconstruction method that adaptively allocates 3D Gaussian primitives based on texture-guided spatial partitioning and hierarchical sampling. By concentrating dense Gaussians in complex regions and using expanded primitives for flat areas, it reduces redundancy and better captures planar geometry. The framework also allows dynamic sparsity control during inference, enabling trade-offs between rendering quality and memory usage without retraining.

By Bing He, Jingnan Gao, Yunuo Chen, Zhengxue Cheng, Rong Xie, Li Song, Wenjun Zhang
arXiv Computer Vision
Aug 25

GaussVid: Sparse-View Gaussian Splatting with 3D-Aware Video Diffusion Priors

GaussVid introduces a 3D-aware video restoration framework that enhances sparse-view 3D Gaussian Splatting (3DGS) reconstructions. By creating a large-scale 3DGS video dataset and employing a camera-conditioned geometric prior anchored on the first and last frames, the method injects spatial structure into video generation, ensuring geometrically grounded restoration across viewpoints. Experiments demonstrate superior pixel- and structure-level fidelity (PSNR/SSIM) and improved multi-view consistency compared to other video-prior restoration methods, while maintaining competitive perceptual quality (LPIPS).

By Xinhui Liu, Can Wang, Wei Jiang, Wei Wang, Dong Xu
Hugging Face Trending Papers
5d ago

OctreeSplat: Hierarchical Octree-Guided Feed-Forward Gaussian Splatting

OctreeSplat introduces a hierarchical octree-guided feed‑forward Gaussian splatting method that extracts multi‑view features and geometric priors from a frozen visual foundation model. By constructing a hierarchical octree and predicting densification scores, it allocates Gaussian primitives at spatially varying densities, improving depth rendering and surface reconstruction. The approach requires only 76 million additional parameters and 35 GPU‑hours to train, and demonstrates competitive RGB view synthesis, depth synthesis, and surface reconstruction on Replica, TUM, Tanks and Temples, and DTU datasets while reducing the number of Gaussian primitives needed.

arXiv Computer Vision
Sep 24

Fusion-Aware Direct 3D Gaussian Generation with Structured Patch Latent Flows

The paper introduces a fusion‑aware hierarchical Gaussian patch representation that enables direct class‑guided generation of 3D Gaussian Splatting (3DGS) objects. By decomposing irregular Gaussian sets into canonical local patches and encoding them as structured tokens, the method fuses global class semantics with patch‑level geometry, appearance, spatial correspondence, and rendering‑sensitive cues. A structure‑aware rectified flow model, conditioned on patch positions and coupled with global‑local velocity prediction and density‑aware weighting, produces class‑conditioned 3DGS objects within seconds, achieving more coherent geometry, sharper local details, and better multi‑view consistency than baseline models.

By Yizhao Wang, Jingbo Wang, Guantao Zhang