arXiv AI

SemDynReg: Semantics-Guided Deformation Regularization for Dynamic 3D Gaussian Splatting

arXiv:2606. 28656v1 Announce Type: cross Abstract: Deformable 3D Gaussian Splatting (3DGS) has emerged as an efficient approach for rendering dynamic scenes in a wide range of 3D applications.

arXiv Computer Vision
Sep 3

PointGauss: Point Cloud-Guided Multi-Object Segmentation for Gaussian Splatting

PointGauss is a 3D-native framework that performs semantic parsing and instance segmentation on 3D Gaussian splatting representations by treating Gaussian primitives as unstructured point sets and extracting scale‑invariant geometric features with Point Transformer V3. It introduces an adaptive region‑of‑interest cropping strategy and an instance‑aware distance‑constrained rasterization pipeline to enable scalable, view‑consistent pixel‑level projections. The authors also release SplatSeg‑360, a cross‑scale benchmark with 32 complex scenes and over 6,300 aligned 2D‑3D masks, and show that PointGauss achieves real‑time performance with state‑of‑the‑art 3D‑mIoU (~90%) and 2D‑mIoU (~80%) scores.

By Wentao Sun, Yiping Chen, John S. Zelek, Jonathan Li
arXiv Computer Vision
Sep 24

GaussianDS: Depth-supervised Semantic Gaussian Splatting for Scene Understanding

GaussianDS introduces a depth‑supervised framework for 3D Gaussian Splatting that jointly optimizes RGB appearance, depth, and compact semantics from scratch. By arranging multi‑view images into a pose‑aware pseudo‑video and propagating view‑consistent masks via SAM2, the method aligns semantic lifting with geometric cues, using depth supervision and edge‑aware refinement to curb semantic drift and boundary leakage. The approach achieves state‑of‑the‑art performance on LERF and 3D‑OVS benchmarks while preserving high‑fidelity reconstruction and enabling downstream tasks such as 3D object removal.

By Yufei Zhang, Chenlu Zhan, Hongwei Wang
arXiv Computer Vision
Sep 25

PePESeg3D: Perception Prior Enhances Multi-Scale Segmentation for 3D Gaussian Splatting

PePESeg3D introduces perception priors into a multi‑scale 3D Gaussian segmentation pipeline, integrating monocular depth and mask constraints during geometry reconstruction and dense depth‑color cues with view‑consistent centroid supervision during contrastive feature learning. This dual‑stage approach aligns geometry with semantic structure and compensates for incomplete mask supervision from 2D foundation models. Experiments on SPIn‑NeRF, LERF‑Mask, and NVOS benchmarks show state‑of‑the‑art performance in both multi‑scale segmentation and scene reconstruction.

By Sungjae Choi, Seunghee Koh, Junmo Kim
arXiv AI
Sep 4

TruncGradGS: Improved 3D Gaussian Splatting via Truncated Gradient Updates

The paper introduces TruncGradGS, a piecewise truncated gradient approach that mitigates gradient vanishing in 3D Gaussian Splatting, enhancing optimization stability and robustness to initializations. It demonstrates consistent improvements over random and COLMAP initializations in both static and dynamic settings. Additionally, the authors highlight limitations of existing dynamic scene benchmarks and present a new synthetic dataset for evaluating dynamic Gaussian Splatting.

By Theo Morales, Nhat-Quynh Le-Pham, Robin Atkins, Binh-Son Hua
arXiv Computer Vision
Sep 4

P-CORE: Self-Supervised Surface Consistency for Point-Based Neural Editing

P-CORE introduces a self‑supervised surface consistency technique for point‑based neural representations, enabling robust adaptation to large deformations without needing ground‑truth deformed images. By generating random deformations and enforcing that the predicted surface after deformation matches the deformation applied to the original surface prediction, the method leverages attention‑based point representations with a learned interpolation kernel. Experiments on synthetic benchmarks and real‑world datasets show improved zero‑shot editing performance and reduced artifacts compared to existing point‑based approaches.

By Yanshu Zhang, Shichong Peng, Mehran Aghabozorgi, Alireza Moazeni, Ke Li
arXiv Computer Vision
Sep 4

Rethinking 3D Noise: Learning 3D-Aware Video Priors via Optimization-Free Morphological Perturbations

The paper introduces 3D Morphological Perturbations, an optimization‑free regularizer for 3D representations such as NeRF and 3D Gaussian Splatting. By treating each Gaussian as a pixel‑like element, the method applies scale, rotation, and pruning perturbations to preserve spatial consistency across views, eliminating the need for per‑scene optimization during dataset curation. Experiments on a lightweight video diffusion sandbox and a 14B‑parameter video model show that the approach improves geometric priors, reduces mean depth error by 12.5% over state‑of‑the‑art 3D artifact refiners, and boosts downstream robotics policy success rates by up to 8.0% on three manipulation tasks.

By Onat \c{S}ahin, Mohammad Altillawi, George Eskandar, Carlos Carbone, Ziyuan Liu
Hugging Face Trending Papers
Jul 2

Online Segment 3D Gaussians via Launching Virtual Drones

Interactive segmentation of 3D Gaussians offers a compelling opportunity for real-time manipulation of 3D scenes, thanks to the real-time rendering capability of 3D Gaussian Splatting (3DGS). However, existing methods require a time-consuming per-scene setup - typically tens of seconds or even minutes - before interactive segmentation can begin on a raw 3DGS scene.

arXiv Computer Vision
Aug 31

WilLaGS: Latent-Conditional 3D Appearance Fields for Robust Gaussian Splatting In-the-Wild

WilLaGS introduces a unified framework that enhances 3D Gaussian Splatting for in-the-wild scenes by learning a continuous global appearance manifold with a β‑VAE and generating dynamic Tri‑Plane features for spatially‑varying local illumination. It also incorporates a self‑supervised perceptual masking mechanism using a Teacher‑Student EMA architecture to suppress transient artifacts and identify inconsistent regions. Experiments on multiple datasets show that WilLaGS achieves state‑of‑the‑art reconstruction quality and novel view synthesis while preserving real‑time rendering efficiency.

By Yuhao Bai, Qianqiu Tan, Lilong Chen, Huanhuan Lv, Lijun Chen