arXiv Computer Vision
Sep 18

Open-vocabulary 3D object detection with promptable segmentation

The paper introduces an open‑vocabulary 3D object detection pipeline that uses a promptable segmentation model (SAM3) to generate instance masks from six surround‑view cameras. These masks are converted into metric 3D boxes, achieving up to 0.413 mAP/0.555 NDS without any training when supervised box geometry is borrowed at inference. The approach also improves a supervised LiDAR‑only detector by 0.034 mAP through a camera‑witness rule, demonstrating that measurement precision, not 2D detection, limits performance.

By \"Omer Faruk Deniz, Mustafa Taha Ko\c{c}yi\u{g}it
arXiv AI
Jun 2

DeepIPCv3: Event-Aware Multi-Modal Sensor Fusion for Sudden Pedestrian Crossing Avoidance

arXiv:2606. 01277v1 Announce Type: cross Abstract: Current end-to-end autonomous driving systems predominantly rely on frame-based sensors, which suffer from inherent perception latency and motion blur during highly dynamic encounters, specifically sudden pedestrian crossings.

By Oskar Natan, Andi Dharmawan, Aufaclav Zatu Kusuma Frisky, Jazi Eko Istiyanto, Jun Miura
arXiv Computer Vision
Sep 7

Out-of-Distribution Semantic Occupancy Prediction

The paper introduces Out-of-Distribution Semantic Occupancy Prediction, a task that focuses on detecting unknown objects in 3D voxel space for autonomous driving. It proposes Realistic Anomaly Augmentation to create two new datasets, VAA-KITTI and VAA-KITTI-360, and presents the OccOoD framework, which uses Cross‑Space Semantic Refinement to improve OoD detection while maintaining semantic occupancy accuracy. Experiments show OccOoD achieves an AuROC of 65.50% and an AuPRCr of 31.83% within a 1.2 m radius, demonstrating strong generalization to real‑world urban scenes.

By Yuheng Zhang, Mengfei Duan, Kunyu Peng, Yuhang Wang, Ruiping Liu, Fei Teng, Kai Luo, Zhiyong Li, Kailun Yang