arXiv Computer Vision

ROVR-Open-Dataset: A Large-Scale Depth Dataset for Autonomous Driving

arXiv Computer Vision
4d ago

WorkIng: A Real-World and Synthetic Highway Work-Zone Benchmark Dataset for Autonomous Navigation

WorkIng is a dual-domain benchmark for autonomous navigation in highway work zones, offering a real-world dataset (WorkIng-Highway) with 360° multi‑modal sensor data and over 12,000 annotated frames, and a synthetic counterpart (WorkIng-CARLA) that simulates 24 regulation‑aware scenarios across six topologies and traffic standards. The benchmark includes 227,399 tracked 3D bounding boxes and 100+ custom 3D assets. Experiments show that real‑world data drives performance, while scenario‑stratified synthetic augmentation improves 2D recognition, 3D detection, and trajectory planning.

By Xujun Xie, Dominik R\"o{\ss}le, Adithya Mohan, Daniel Cremers, Torsten Sch\"on
arXiv Machine Learning
Jun 3

The Road Ahead in Autonomous Driving: The KITScenes Multimodal Dataset

arXiv:2606. 02956v1 Announce Type: cross Abstract: Existing autonomous driving datasets have enabled major progress, but fall short in sensor fidelity, map completeness, or geographic diversity.

By Richard Schwarzkopf, Fabian Immel, Alexander Blumberg, Jonas Merkert, Nils Rack, Kaiwen Wang, Fabian Konstantinidis, Julian Truetsch, Carlos Fernandez, Annika B\"atz, Kevin R\"osch, Marlon Steiner, Willi Poh, Yinzhe Shen, Royden Wagner, Felix Hauser, Dominik Strutz, Jaime Villa, Gleb Stepanov, Holger Caesar, \"Omer \c{S}ahin Ta\c{s}, Frank Bieder, Jan-Hendrik Pauls, Christoph Stiller
Hugging Face Trending Papers
Sep 8

DXPR: Depth-Based Vision-LiDAR Cross-Modal Place Recognition Using Vision Foundation Models

DXPR is a depth‑based cross‑modal place recognition framework that matches monocular camera queries to a LiDAR map using a single vision foundation model backbone. By converting both modalities into a unified depth image representation, DXPR learns modality‑invariant global descriptors without modality‑specific encoders. A geometry‑aware overlap miner refines pairwise metric learning by computing pixel‑level overlap scores, and extensive tests on KITTI and Boreas show strong performance across seasons, weather, and day/night conditions, outperforming prior CMPR baselines.

arXiv Computer Vision
Sep 21

Refining Ground Truth Poses in Autonomous Driving Datasets via Neural Rendering

arXiv:2504.15776v2 Announce Type: replace Abstract: Public autonomous driving datasets underpin the training and benchmarking of perception, mapping, and localization algorithms, yet residual inaccur...

By Quentin Herau, Nathan Piasco, Moussab Bennehar, Luis Rold\~ao, Dzmitry Tsishkou, Bingbing Liu, Cyrille Migniot, Pascal Vasseur, C\'edric Demonceaux
arXiv Computer Vision
Oct 19

PanoBench: A Panoptic Occupancy Prediction Benchmark for Autonomous Driving

PanoBench is a new camera‑centric benchmark for panoptic occupancy prediction that unifies 3D geometry, semantics, and instance identities across synthetic and real‑world driving scenes. It combines three datasets—PanoBench‑CarlaOcc, PanoBench‑nuScenes, and PanoBench‑KITTI360—through canonical interfaces and unified evaluation protocols, providing multi‑resolution annotations with persistent instance identities. The benchmark introduces a novel reconstruction pipeline for real‑world data, a unified valid‑mask protocol, and analyses of observation fidelity, geometric completeness, spatial continuity, and temporal consistency, while also benchmarking methods on semantic, panoptic, and 4D occupancy forecasting. whyItMatters":"PanoBench addresses the scarcity of instance‑aware annotations in panoptic occupancy research by offering comprehensive, high‑quality annotations and evaluation protocols that enable more robust development and comparison of autonomous driving perception methods."

By Yi Feng, Zizhan Guo, Junwu E, Yu Ma, Mengtan Zhang, Jin Wu, Wei Ye, Hanli Wang, Qijun Chen, Danwei Wang, Rui Fan
arXiv AI
Oct 19

DriveWorld3D Evidence Constrained 3D World Modeling and Generative Simulation for Real-World Autonomous Driving

DriveWorld3D is a framework that integrates temporal video learning, multi‑sensor measurement constraints, and offline generative simulation to build a unified 3D world model for autonomous driving. Its online component tracks road surfaces, volumetric occupancy, dynamic entities, and road relations while explicitly managing physical occupancy, observability, and evidence provenance. The offline component reconstructs scenes with neural radiance fields or 3D Gaussian Splatting and expands rare conditions using generative models, but limits generated content from being used as geometric ground truth.

By Wei Wang (Robostreet research team Cambridge, MA, USA), Yiru Veronika Wang (Robostreet research team Cambridge, MA, USA), Yihan Wang (Robostreet research team Cambridge, MA, USA), Zihao Li (Robostreet research team Cambridge, MA, USA), Xiaohui Liang (Robostreet research team Cambridge, MA, USA)
arXiv Computer Vision
Oct 26

DriveOSS: Dataset and Benchmark for 3D Anomaly Segmentation and Open-set Semantic Segmentation in Autonomous Driving

DriveOSS is a new real‑world multimodal dataset and benchmark for 3D anomaly segmentation and open‑set semantic segmentation in autonomous driving. It contains 12,661 synchronized frames from six RGB cameras, a 128‑beam LiDAR, and GPS/IMU, covering 52 driving scenes under various weather conditions. The data are split into in‑distribution (ID) scenes for training and out‑of‑distribution (OOD) scenes for validation and testing, with unknown objects labeled as an outlier class to challenge current 3D perception systems.

By Zhiran Yan, Savankumar Bhanderi, Sourabh Lolge, Rui Song, Girdharbhai Paneliya, Shiva Agrawal, Gordon Elger