arXiv AI By Ruitao Chen, Mozhang Guo, Jinge Li

SemDynReg: Semantics-Guided Deformation Regularization for Dynamic 3D Gaussian Splatting

Read the original on arXiv AI →

arXiv:2606. 28656v1 Announce Type: cross Abstract: Deformable 3D Gaussian Splatting (3DGS) has emerged as an efficient approach for rendering dynamic scenes in a wide range of 3D applications.

Machine-generated by The Flow from the publisher's headline and feed description — not written or checked by a human. The full article lives at arXiv AI.

arXiv Computer Vision
Sep 3

PointGauss: Point Cloud-Guided Multi-Object Segmentation for Gaussian Splatting

PointGauss is a 3D-native framework that performs semantic parsing and instance segmentation on 3D Gaussian splatting representations by treating Gaussian primitives as unstructured point sets and extracting scale‑invariant geometric features with Point Transformer V3. It introduces an adaptive region‑of‑interest cropping strategy and an instance‑aware distance‑constrained rasterization pipeline to enable scalable, view‑consistent pixel‑level projections. The authors also release SplatSeg‑360, a cross‑scale benchmark with 32 complex scenes and over 6,300 aligned 2D‑3D masks, and show that PointGauss achieves real‑time performance with state‑of‑the‑art 3D‑mIoU (~90%) and 2D‑mIoU (~80%) scores.

By Wentao Sun, Yiping Chen, John S. Zelek, Jonathan Li
arXiv Computer Vision
Sep 24

GaussianDS: Depth-supervised Semantic Gaussian Splatting for Scene Understanding

GaussianDS introduces a depth‑supervised framework for 3D Gaussian Splatting that jointly optimizes RGB appearance, depth, and compact semantics from scratch. By arranging multi‑view images into a pose‑aware pseudo‑video and propagating view‑consistent masks via SAM2, the method aligns semantic lifting with geometric cues, using depth supervision and edge‑aware refinement to curb semantic drift and boundary leakage. The approach achieves state‑of‑the‑art performance on LERF and 3D‑OVS benchmarks while preserving high‑fidelity reconstruction and enabling downstream tasks such as 3D object removal.

By Yufei Zhang, Chenlu Zhan, Hongwei Wang
arXiv Computer Vision
Sep 25

PePESeg3D: Perception Prior Enhances Multi-Scale Segmentation for 3D Gaussian Splatting

PePESeg3D introduces perception priors into a multi‑scale 3D Gaussian segmentation pipeline, integrating monocular depth and mask constraints during geometry reconstruction and dense depth‑color cues with view‑consistent centroid supervision during contrastive feature learning. This dual‑stage approach aligns geometry with semantic structure and compensates for incomplete mask supervision from 2D foundation models. Experiments on SPIn‑NeRF, LERF‑Mask, and NVOS benchmarks show state‑of‑the‑art performance in both multi‑scale segmentation and scene reconstruction.

By Sungjae Choi, Seunghee Koh, Junmo Kim
arXiv AI
Sep 4

TruncGradGS: Improved 3D Gaussian Splatting via Truncated Gradient Updates

The paper introduces TruncGradGS, a piecewise truncated gradient approach that mitigates gradient vanishing in 3D Gaussian Splatting, enhancing optimization stability and robustness to initializations. It demonstrates consistent improvements over random and COLMAP initializations in both static and dynamic settings. Additionally, the authors highlight limitations of existing dynamic scene benchmarks and present a new synthetic dataset for evaluating dynamic Gaussian Splatting.

By Theo Morales, Nhat-Quynh Le-Pham, Robin Atkins, Binh-Son Hua
arXiv Computer Vision
Sep 4

P-CORE: Self-Supervised Surface Consistency for Point-Based Neural Editing

P-CORE introduces a self‑supervised surface consistency technique for point‑based neural representations, enabling robust adaptation to large deformations without needing ground‑truth deformed images. By generating random deformations and enforcing that the predicted surface after deformation matches the deformation applied to the original surface prediction, the method leverages attention‑based point representations with a learned interpolation kernel. Experiments on synthetic benchmarks and real‑world datasets show improved zero‑shot editing performance and reduced artifacts compared to existing point‑based approaches.

By Yanshu Zhang, Shichong Peng, Mehran Aghabozorgi, Alireza Moazeni, Ke Li