arXiv Computer Vision

MEGA: Object-Level Mesh Extraction from 3D Gaussian Splatting via Spatial Visual Distillation

MEGA is a new framework that extracts object-level, watertight meshes from 3D Gaussian Splatting (3DGS) scenes. It uses a segment-then-mesh approach, leveraging Spatial Visual Distillation (SVD) to sample diverse camera views of each segmented object and train a mesh reconstruction model with photometric supervision. Experiments on popular benchmarks show that MEGA outperforms existing methods in accurately recovering object-level 3D occupancy and supports complex physical interactions by combining high-quality meshes with photorealistic 3DGS rendering.

arXiv Computer Vision
Sep 3

PointGauss: Point Cloud-Guided Multi-Object Segmentation for Gaussian Splatting

PointGauss is a 3D-native framework that performs semantic parsing and instance segmentation on 3D Gaussian splatting representations by treating Gaussian primitives as unstructured point sets and extracting scale‑invariant geometric features with Point Transformer V3. It introduces an adaptive region‑of‑interest cropping strategy and an instance‑aware distance‑constrained rasterization pipeline to enable scalable, view‑consistent pixel‑level projections. The authors also release SplatSeg‑360, a cross‑scale benchmark with 32 complex scenes and over 6,300 aligned 2D‑3D masks, and show that PointGauss achieves real‑time performance with state‑of‑the‑art 3D‑mIoU (~90%) and 2D‑mIoU (~80%) scores.

By Wentao Sun, Yiping Chen, John S. Zelek, Jonathan Li
Hugging Face Trending Papers
Aug 19

CoMVS-GS: Collaborative Multi-View Stereo and 3D Gaussian Splatting for Surface Reconstruction

CoMVS‑GS is a surface‑reconstruction framework that fuses Multi‑View Stereo (MVS) with 3D Gaussian splatting. It initializes Gaussian primitives from dense MVS points, uses PatchMatch‑3DGS mutual supervision to refine depths and normals, and replaces voxel‑based meshing with a Delaunay graph‑cut pipeline. Experiments on DTU, GauU‑Scene V2, and MatrixCity demonstrate competitive object‑level results and improved geometric accuracy and mesh compactness in outdoor scenes while preserving high rendering quality.

arXiv Computer Vision
Sep 24

GaussianDS: Depth-supervised Semantic Gaussian Splatting for Scene Understanding

GaussianDS introduces a depth‑supervised framework for 3D Gaussian Splatting that jointly optimizes RGB appearance, depth, and compact semantics from scratch. By arranging multi‑view images into a pose‑aware pseudo‑video and propagating view‑consistent masks via SAM2, the method aligns semantic lifting with geometric cues, using depth supervision and edge‑aware refinement to curb semantic drift and boundary leakage. The approach achieves state‑of‑the‑art performance on LERF and 3D‑OVS benchmarks while preserving high‑fidelity reconstruction and enabling downstream tasks such as 3D object removal.

By Yufei Zhang, Chenlu Zhan, Hongwei Wang
Hugging Face Trending Papers
Nov 2

OctreeSplat: Hierarchical Octree-Guided Feed-Forward Gaussian Splatting

OctreeSplat introduces a hierarchical octree-guided feed‑forward Gaussian splatting method that extracts multi‑view features and geometric priors from a frozen visual foundation model. By constructing a hierarchical octree and predicting densification scores, it allocates Gaussian primitives at spatially varying densities, improving depth rendering and surface reconstruction. The approach requires only 76 million additional parameters and 35 GPU‑hours to train, and demonstrates competitive RGB view synthesis, depth synthesis, and surface reconstruction on Replica, TUM, Tanks and Temples, and DTU datasets while reducing the number of Gaussian primitives needed.

arXiv Computer Vision
Sep 25

PePESeg3D: Perception Prior Enhances Multi-Scale Segmentation for 3D Gaussian Splatting

PePESeg3D introduces perception priors into a multi‑scale 3D Gaussian segmentation pipeline, integrating monocular depth and mask constraints during geometry reconstruction and dense depth‑color cues with view‑consistent centroid supervision during contrastive feature learning. This dual‑stage approach aligns geometry with semantic structure and compensates for incomplete mask supervision from 2D foundation models. Experiments on SPIn‑NeRF, LERF‑Mask, and NVOS benchmarks show state‑of‑the‑art performance in both multi‑scale segmentation and scene reconstruction.

By Sungjae Choi, Seunghee Koh, Junmo Kim
arXiv Computer Vision
Oct 22

Unfolding 3D Gaussian Splatting via Iterative Gaussian Synopsis

The paper introduces Iterative Gaussian Synopsis, a top‑down unfolding framework that generates compact, progressive levels of detail for 3D Gaussian Splatting (3DGS). Starting from a full‑resolution 3DGS model, it iteratively prunes Gaussian primitives using a learnable mask, building a multi‑level hierarchy that preserves visual quality while reducing storage. The method combines hierarchical spatial grids with a shared Anchor Codebook to capture global structure and local details, enabling efficient, level‑specific rendering with minimal data overhead.

By Yuqin Lu, Yihua Dai, Yang Zhou, Guiqing Li, Shengfeng He
arXiv Computer Vision
Sep 7

WorldSculpt: Generating Compositional Worlds from Grounded Videos

WorldSculpt presents a method for generating compositional 3D representations of cluttered scenes with hundreds of objects by adapting a single-object 3D generative prior to multi-view observations. The approach, built on Pixal3D with a multi-view conditioning pathway, can generalize to highly occluded scenes without scene-level training. The authors also introduce the UE-MeshyScene benchmark and demonstrate that their method outperforms prior approaches across various evaluation settings, including converting existing 3DGS worlds into compositional mesh scenes.

By Muyao Niu, Jixuan He, Ruihan Yu, Lian Fu, Yonghao Yu, Zheng-Hui Huang, Yifan Zhan, Fengbo Lan, Yongtao Ge, Yinqiang Zheng, Kaipeng Zhang, Zhixiang Wang