arXiv:2609.09881v1 Announce Type: new Abstract: Semantic segmentation for autonomous driving requires reliable detection of vulnerable road users (VRUs) despite heavy class imbalance. We introduce CL...
IGLOSS introduces a zero‑shot open‑vocabulary semantic segmentation approach for 3D automotive LiDAR data. The method generates prototype images from text to bridge the image‑text modality gap, then matches 3D point features with 2D image features derived from a Vision Foundation Model. It achieves state‑of‑the‑art results on nuScenes and SemanticKITTI, with code, models, and images publicly available.
DriveOSS is a new real‑world multimodal dataset and benchmark for 3D anomaly segmentation and open‑set semantic segmentation in autonomous driving. It contains 12,661 synchronized frames from six RGB cameras, a 128‑beam LiDAR, and GPS/IMU, covering 52 driving scenes under various weather conditions. The data are split into in‑distribution (ID) scenes for training and out‑of‑distribution (OOD) scenes for validation and testing, with unknown objects labeled as an outlier class to challenge current 3D perception systems.
The paper introduces a multi-vehicle dataset that includes camera, LiDAR, and radar sensor data along with scanned 3D models of all vehicles. Each vehicle’s pose and continuous kinematics are provided via RTK‑GNSS, enabling precise knowledge of the dynamic surroundings at any time. The dataset supports single‑ and multi‑object recordings with seven target vehicles, allowing evaluation of measurement effects such as occlusion and reflections thanks to known vehicle surface normals.
arXiv:2605.31177v2 Announce Type: replace Abstract: Plain Transformers have become the de-facto architecture for processing text, audio, image, and video, offering a unified backbone for multimodal l...
The paper introduces an edge‑assisted crowdsensing framework that uses handlebar‑mounted cameras to capture street‑level video, a vision‑language model to extract structured traffic attributes, and an explainable boosting machine to combine these with OpenStreetMap data and on‑bike kinematics for a 1‑9 safety score. On 1,362 annotated frames from two London routes, the model achieves 72.2 % binary accuracy and a mean absolute error of 1.011, with feature attribution revealing the impact of lane separation, painted lanes, and construction sites on safety ratings. The system operates efficiently at the network edge, requiring only 2.49 s per frame for extraction and 0.4 ms for scoring, and supports continuous monitoring at a cost of 1.4 accuracy points for 1,000 riders over a 20‑second interval.
Lang3DSeg introduces a point‑transformer backbone for open‑vocabulary, annotation‑free 3D LiDAR segmentation, trained from scratch without geometric pre‑training. It tackles noise from 2D‑to‑3D label projections by applying a class‑priority rule and truncating projected instances at depth gaps, thereby correcting depth‑ambiguity errors. The method achieves state‑of‑the‑art results on nuScenes (52.8 % mIoU) and SemanticKITTI (41.4 % mIoU) while operating in real‑time on a single LiDAR sweep.
MILER is an end‑to‑end reinforcement learning framework that achieves zero‑shot sim‑to‑real transfer for autonomous driving in unstructured environments. It uses a custom semantic mid‑level representation (MLR) simulator for offline training, and during deployment it processes real camera and LiDAR data with BEVFusion to produce a compatible bird’s‑eye‑view representation. The policy’s actions are applied via a trajectory‑alignment strategy, allowing the system to drive 17.3 km on a 3.0 km test track without human intervention, all running on a Jetson AGX Orin.
arXiv:2609.17413v1 Announce Type: new Abstract: This paper investigates easy strategies to boost the performance of existing networks for lidar semantic scene completion (SSC) without requiring compl...
arXiv:2606. 20189v1 Announce Type: cross Abstract: Leveraging Vision Foundation Models (VFMs) for camera-to-LiDAR knowledge distillation offers a promising solution to the scarcity of annotated data needed to represent the immense geometric and kinematic diversity of real-world autonomous driving (AD).
arXiv:2606. 20189v3 Announce Type: replace-cross Abstract: Leveraging Vision Foundation Models (VFMs) for camera-to-LiDAR knowledge distillation offers a promising solution to the scarcity of annotated data needed to represent the immense geometric and kinematic diversity of real-world autonomous driving (AD).
arXiv:2610.18686v1 Announce Type: cross Abstract: 3D semantic occupancy prediction is crucial for autonomous driving, but camera-based methods degrade in low-light conditions and LiDAR-based methods...