arXiv Computer Vision
Oct 21

Provisioning Robust and Efficient LiDAR Perception for Autonomous Driving

The paper presents a method for creating LiDAR-based 3D object detectors that remain accurate under point‑cloud corruptions while meeting strict latency and memory constraints. It achieves robustness by generating corrupted samples that mimic extreme weather and training detectors to focus on hard samples, guided by perturbation sensitivity estimated from an ensemble of seven heterogeneous detectors. Efficiency is improved by narrowing the network and using offline neighborhood‑density measurements to reduce the number of points processed at each sampling stage, resulting in significant gains in AP under corruption and reductions in inference latency and GPU memory usage across multiple datasets and detector architectures.

By Tingxu Han, Zijie Shen, An Guo, Lyuke Wang, Chunrong Fang, Zhenyu Chen, Wei Song
arXiv Machine Learning
2d ago

Role-based Effectiveness of an Epistemic Uncertainty Estimate in Training Models for Semantic Segmentation of 3D LiDAR Point Clouds

The paper studies how epistemic uncertainty estimates can be used in different ways—either as an additional input feature or as a per‑sample confidence weight in the loss function—to improve 3D LiDAR point cloud segmentation. Experiments on four large‑scale LiDAR benchmarks (ISPRS Vaihingen, AHN3, Paris‑Lille‑3D, and Toronto‑3D) show that uncertainty‑aware models outperform a baseline ANN in mean Intersection over Union, recover minority classes, and better align prediction error with estimated uncertainty. The results suggest that uncertainty can serve multiple roles in the segmentation pipeline beyond merely boosting accuracy.

By Krishnakumar N, Jaya Sreevalsan-Nair
arXiv Computer Vision
Sep 18

Open-vocabulary 3D object detection with promptable segmentation

The paper introduces an open‑vocabulary 3D object detection pipeline that uses a promptable segmentation model (SAM3) to generate instance masks from six surround‑view cameras. These masks are converted into metric 3D boxes, achieving up to 0.413 mAP/0.555 NDS without any training when supervised box geometry is borrowed at inference. The approach also improves a supervised LiDAR‑only detector by 0.034 mAP through a camera‑witness rule, demonstrating that measurement precision, not 2D detection, limits performance.

By \"Omer Faruk Deniz, Mustafa Taha Ko\c{c}yi\u{g}it