arXiv Computer Vision

Semantic-ITC: A Frame-wise Indoor Mobile Laser Scanning Dataset and Benchmark for Semantic Segmentation

arXiv Computer Vision
Oct 8

MultiFly: A Real-World Multimodal Aerial Dataset with Annotation-Efficient Label Transfer and Cross-Modal Semantic Consistency

arXiv:2610.10359v1 Announce Type: cross Abstract: We introduce MultiFly, a real-world, low-altitude UAV dataset for semantic perception across RGB, thermal, LiDAR, and radar modalities. MultiFly prov...

By Markus Gross, Andreas Greiner, Taehyoung Kim, Sivasubiramaniam Subbiah, Toma\v{z} Coti\v{c}, Sai Bharadwaj Matha, Conrad Christoph, Oussema Dhaouadi, Simon Zieher, Surya Vijaya Kumar, Gordon Elger, Henri Mee{\ss}, Olaf Wysocki, Paul Spannaus, Daniel Cremers
arXiv Machine Learning
Oct 23

RaSFNet: Ray-aligned and Scan-aware Fusion Network for LiDAR Semantic Segmentation

RaSFNet introduces a Ray-aligned and Scan-aware Fusion Network for LiDAR semantic segmentation, addressing limitations of projection-based methods by preserving geometric differences within each frustum and modeling spatial relationships across scanning regions. It employs a Ray-Aligned Geometric Distribution Encoding (RAGDE) module, a Scan-Topology-Aware Mamba (STAM) block, and a Range-Constrained Point-Frustum Fusion (RCPFF) mechanism to integrate point cloud geometry, LiDAR scanning characteristics, and range information. The network achieves competitive mIoU scores of 70.2% on SemanticKITTI and 77.7% on nuScenes validation sets.

By Chuang Chen
arXiv Computer Vision
Oct 2

Lang3DSeg: Annotation-Free Open-Vocabulary 3D Segmentation with Point Transformers

Lang3DSeg introduces a point‑transformer backbone for open‑vocabulary, annotation‑free 3D LiDAR segmentation, trained from scratch without geometric pre‑training. It tackles noise from 2D‑to‑3D label projections by applying a class‑priority rule and truncating projected instances at depth gaps, thereby correcting depth‑ambiguity errors. The method achieves state‑of‑the‑art results on nuScenes (52.8 % mIoU) and SemanticKITTI (41.4 % mIoU) while operating in real‑time on a single LiDAR sweep.

By Cigdem Kokenoz, Amir Salarpour, Alkim Domeke, Christopher Salas, Pedram MohajerAnsari, Long Cheng, Mert D. Pes\'e, Bing Li
arXiv Computer Vision
Oct 22

Data-Efficient Semantic Segmentation of 3D Point Clouds via Open-Vocabulary Image Segmentation-based Pseudo-Labeling

The paper introduces PLOVIS, a data‑efficient framework for semantic segmentation of 3D point clouds that tackles three simultaneous data shortages: few training scenes, sparse point‑level labels, and missing 2D image sequences. PLOVIS generates pseudo‑labels by applying an open‑vocabulary image segmentation model directly to 3D point clouds, then refines these labels through a two‑stage filtering process and a class‑balanced memory bank. Experiments on ScanNet, S3DIS, Toronto3D, and Semantic3D show that PLOVIS outperforms existing fine‑tuning and weakly supervised methods under realistic, data‑scarce conditions.

By Takahiko Furuya
arXiv Computer Vision
Sep 25

SplatLabel: Pseudo-Labelling through 4D Gaussian Splatting

SplatLabel is an automated pipeline that uses a 4D Gaussian representation to generate LiDAR segmentation and semantic occupancy grids with predictive confidence. It models dynamic scenes through an explicit temporal manifold, tracking moving actors without requiring pre‑annotated 3D bounding boxes. By integrating 360‑degree LiDAR depth maps and distilling soft probabilities from 2D models, it resolves semantic ambiguities over time and space, and evaluates pseudo‑labels via a selective classification framework that balances precision and recall.

By Nitya Nanvani, Andras Palffy, Holger Caesar
arXiv Computer Vision
Aug 27

Bootstrapping a 4D LiDAR Annotation Tool from Video Foundation Models

The paper introduces LiDAR‑SAM2, a framework that converts the 2D video foundation model SAM2 into a scalable source of supervision for 4D LiDAR data. By projecting SAM2 video masks into multi‑view LiDAR space and aggregating them temporally, the method automatically generates temporally coherent LiDAR labels without human annotation. Experiments on SemanticKITTI show that these automatically produced semantic and panoptic labels achieve quality close to full human annotation, enabling models trained on them to approach the performance of fully supervised systems.

By Jihun Kim, Hyun-Kurl Jang, Hyemin Yang, Jinnyeong Yang, Hyeokjun Kweon, Kuk-Jin Yoon