arXiv Computer Vision

SplatLabel: Pseudo-Labelling through 4D Gaussian Splatting

arXiv Computer Vision
Aug 27

Bootstrapping a 4D LiDAR Annotation Tool from Video Foundation Models

The paper introduces LiDAR‑SAM2, a framework that converts the 2D video foundation model SAM2 into a scalable source of supervision for 4D LiDAR data. By projecting SAM2 video masks into multi‑view LiDAR space and aggregating them temporally, the method automatically generates temporally coherent LiDAR labels without human annotation. Experiments on SemanticKITTI show that these automatically produced semantic and panoptic labels achieve quality close to full human annotation, enabling models trained on them to approach the performance of fully supervised systems.

By Jihun Kim, Hyun-Kurl Jang, Hyemin Yang, Jinnyeong Yang, Hyeokjun Kweon, Kuk-Jin Yoon
arXiv AI
Jun 24

HilDA: Hierarchical Distillation with Diffusion for Advancing Self-Supervised LiDAR Pre-training

arXiv:2606. 20189v3 Announce Type: replace-cross Abstract: Leveraging Vision Foundation Models (VFMs) for camera-to-LiDAR knowledge distillation offers a promising solution to the scarcity of annotated data needed to represent the immense geometric and kinematic diversity of real-world autonomous driving (AD).

By Maciej Wozniak, Jesper Ericsson, Hariprasath Govindarajan, Truls Nyberg, Thomas Gustafsson, Patric Jensfelt, Olov Andersson
arXiv AI
Jun 19

HilDA: Hierarchical Distillation with Diffusion for Advancing Self-Supervised LiDAR Pre-trainin

arXiv:2606. 20189v1 Announce Type: cross Abstract: Leveraging Vision Foundation Models (VFMs) for camera-to-LiDAR knowledge distillation offers a promising solution to the scarcity of annotated data needed to represent the immense geometric and kinematic diversity of real-world autonomous driving (AD).

By Maciej Wozniak, Jesper Ericsson, Hariprasath Govindarajan, Truls Nyberg, Thomas Gustafsson, Patric Jensfelt, Olov Andersson
arXiv Computer Vision
Sep 4

DIAL-GS: Dynamic Instance Aware Reconstruction for Label-free Street Scenes with 4D Gaussian Splatting

DIAL-GS introduces a dynamic instance-aware reconstruction technique for label-free street scenes using 4D Gaussian Splatting. It identifies dynamic instances by detecting appearance-position inconsistencies between warped renderings and actual observations, then employs instance-aware 4D Gaussians to create a unified volumetric representation that adapts to dynamics. A reciprocal mechanism further strengthens identity and dynamics, leading to improved reconstruction quality and instance-level editing compared to existing self-supervised baselines.

By Chenpeng Su, Wenhua Wu, Chensheng Peng, Tianchen Deng, Zhe Liu, Hesheng Wang