arXiv Computer Vision By Chi Zhang, Qi Song, Feifei Li, Jie Li, Rui Huang

LetOccVote: Learning Weakly Supervised 3D Occupancy through Consensus

Read the original on arXiv Computer Vision →

LetOccVote is a weakly supervised framework for 3D occupancy prediction that uses 2D pseudo-labels from vision foundation models. It introduces cross‑frame voting mechanisms—Depth Vote for geometric consistency and Semantic Vote for semantic reliability—to filter out erroneous pseudo-labels before training. The method achieves state‑of‑the‑art results on Occ3D‑nuScenes using only 2D supervision.

Machine-generated by The Flow from the publisher's headline and feed description — not written or checked by a human. The full article lives at arXiv Computer Vision.

arXiv Computer Vision
Sep 25

SplatLabel: Pseudo-Labelling through 4D Gaussian Splatting

SplatLabel is an automated pipeline that uses a 4D Gaussian representation to generate LiDAR segmentation and semantic occupancy grids with predictive confidence. It models dynamic scenes through an explicit temporal manifold, tracking moving actors without requiring pre‑annotated 3D bounding boxes. By integrating 360‑degree LiDAR depth maps and distilling soft probabilities from 2D models, it resolves semantic ambiguities over time and space, and evaluates pseudo‑labels via a selective classification framework that balances precision and recall.

By Nitya Nanvani, Andras Palffy, Holger Caesar
arXiv Computer Vision
Sep 24

GaussianDS: Depth-supervised Semantic Gaussian Splatting for Scene Understanding

GaussianDS introduces a depth‑supervised framework for 3D Gaussian Splatting that jointly optimizes RGB appearance, depth, and compact semantics from scratch. By arranging multi‑view images into a pose‑aware pseudo‑video and propagating view‑consistent masks via SAM2, the method aligns semantic lifting with geometric cues, using depth supervision and edge‑aware refinement to curb semantic drift and boundary leakage. The approach achieves state‑of‑the‑art performance on LERF and 3D‑OVS benchmarks while preserving high‑fidelity reconstruction and enabling downstream tasks such as 3D object removal.

By Yufei Zhang, Chenlu Zhan, Hongwei Wang
arXiv Computer Vision
Oct 2

Lang3DSeg: Annotation-Free Open-Vocabulary 3D Segmentation with Point Transformers

Lang3DSeg introduces a point‑transformer backbone for open‑vocabulary, annotation‑free 3D LiDAR segmentation, trained from scratch without geometric pre‑training. It tackles noise from 2D‑to‑3D label projections by applying a class‑priority rule and truncating projected instances at depth gaps, thereby correcting depth‑ambiguity errors. The method achieves state‑of‑the‑art results on nuScenes (52.8 % mIoU) and SemanticKITTI (41.4 % mIoU) while operating in real‑time on a single LiDAR sweep.

By Cigdem Kokenoz, Amir Salarpour, Alkim Domeke, Christopher Salas, Pedram MohajerAnsari, Long Cheng, Mert D. Pes\'e, Bing Li
arXiv Computer Vision
Sep 24

Hybrid Gaussians for Robust Open-Vocabulary 3D Segmentation with Multi-View Object Association and Boundary Refinement

Hybrid Gaussians is a new 3D representation that jointly models object association and language-aligned semantics for open‑vocabulary 3D segmentation. It uses a Multi‑View Object Association mechanism that combines Observation Fusion and Semantic Contrastive Learning to improve identity consistency and semantic discrimination, and a Boundary Reconstruction Optimization to refine local boundary structure. Experiments on LERF and 3D‑OVS show strong quantitative and qualitative results, achieving 59.1% mIoU on LERF, a 13.4% relative gain over the baseline.

By Xueqi Qiu, Yueming Sun, Tianyu Zhang, Yuxuan Xia, Yang Long