arXiv:2610.27547v1 Announce Type: new
Abstract: Online LiDAR-camera calibration remains a fundamental yet challenging task in the field of robotics. Recently, deep learning-based data-driven approach...
By Huihua Zhu, Shuyang Zhang, Dongqing Chen, Zhuo Yu, Jianhao Jiao, Yilong Zhu, Siyu Teng, Xiaopin Zhong, Zongze Wu
WorkIng is a dual-domain benchmark for autonomous navigation in highway work zones, offering a real-world dataset (WorkIng-Highway) with 360° multi‑modal sensor data and over 12,000 annotated frames, and a synthetic counterpart (WorkIng-CARLA) that simulates 24 regulation‑aware scenarios across six topologies and traffic standards. The benchmark includes 227,399 tracked 3D bounding boxes and 100+ custom 3D assets. Experiments show that real‑world data drives performance, while scenario‑stratified synthetic augmentation improves 2D recognition, 3D detection, and trajectory planning.
By Xujun Xie, Dominik R\"o{\ss}le, Adithya Mohan, Daniel Cremers, Torsten Sch\"on
arXiv:2608. 07579v1 Announce Type: cross Abstract: The AI City Challenge 2026 Track 1 evaluates multi-camera 3D perception in large indoor warehouses under a synthetic-to-real (Sim2Real) setting; depth is available only for training and validation, so inference is RGB-only.
By Abdullah Naeem, Anav Katwal, Ayon Dey, Noman Khan, Md Tamjidul Hoque
arXiv:2606. 02956v1 Announce Type: cross Abstract: Existing autonomous driving datasets have enabled major progress, but fall short in sensor fidelity, map completeness, or geographic diversity.
By Richard Schwarzkopf, Fabian Immel, Alexander Blumberg, Jonas Merkert, Nils Rack, Kaiwen Wang, Fabian Konstantinidis, Julian Truetsch, Carlos Fernandez, Annika B\"atz, Kevin R\"osch, Marlon Steiner, Willi Poh, Yinzhe Shen, Royden Wagner, Felix Hauser, Dominik Strutz, Jaime Villa, Gleb Stepanov, Holger Caesar, \"Omer \c{S}ahin Ta\c{s}, Frank Bieder, Jan-Hendrik Pauls, Christoph Stiller
arXiv:2307. 06647v4 Announce Type: replace-cross Abstract: We propose DeepIPCv2, an end-to-end autonomous driving framework that integrates LiDAR-based environmental perception with command-specific control learning.
By Oskar Natan, Jun Miura
DXPR is a depth‑based cross‑modal place recognition framework that matches monocular camera queries to a LiDAR map using a single vision foundation model backbone. By converting both modalities into a unified depth image representation, DXPR learns modality‑invariant global descriptors without modality‑specific encoders. A geometry‑aware overlap miner refines pairwise metric learning by computing pixel‑level overlap scores, and extensive tests on KITTI and Boreas show strong performance across seasons, weather, and day/night conditions, outperforming prior CMPR baselines.
arXiv:2610.19201v1 Announce Type: new
Abstract: We present LidarVerse, a real-time unified LiDAR world model for sensor simulation across tasks and sensors. Existing LiDAR simulators largely follow o...
By Henry Che, Xuanchi Ren, Sanja Fidler, Shenlong Wang, Laura Leal-Taix\'e, Shengyu Huang
arXiv:2504.15776v2 Announce Type: replace
Abstract: Public autonomous driving datasets underpin the training and benchmarking of perception, mapping, and localization algorithms, yet residual inaccur...
By Quentin Herau, Nathan Piasco, Moussab Bennehar, Luis Rold\~ao, Dzmitry Tsishkou, Bingbing Liu, Cyrille Migniot, Pascal Vasseur, C\'edric Demonceaux
PanoBench is a new camera‑centric benchmark for panoptic occupancy prediction that unifies 3D geometry, semantics, and instance identities across synthetic and real‑world driving scenes. It combines three datasets—PanoBench‑CarlaOcc, PanoBench‑nuScenes, and PanoBench‑KITTI360—through canonical interfaces and unified evaluation protocols, providing multi‑resolution annotations with persistent instance identities. The benchmark introduces a novel reconstruction pipeline for real‑world data, a unified valid‑mask protocol, and analyses of observation fidelity, geometric completeness, spatial continuity, and temporal consistency, while also benchmarking methods on semantic, panoptic, and 4D occupancy forecasting.
whyItMatters":"PanoBench addresses the scarcity of instance‑aware annotations in panoptic occupancy research by offering comprehensive, high‑quality annotations and evaluation protocols that enable more robust development and comparison of autonomous driving perception methods."
By Yi Feng, Zizhan Guo, Junwu E, Yu Ma, Mengtan Zhang, Jin Wu, Wei Ye, Hanli Wang, Qijun Chen, Danwei Wang, Rui Fan
DriveWorld3D is a framework that integrates temporal video learning, multi‑sensor measurement constraints, and offline generative simulation to build a unified 3D world model for autonomous driving. Its online component tracks road surfaces, volumetric occupancy, dynamic entities, and road relations while explicitly managing physical occupancy, observability, and evidence provenance. The offline component reconstructs scenes with neural radiance fields or 3D Gaussian Splatting and expands rare conditions using generative models, but limits generated content from being used as geometric ground truth.
By Wei Wang (Robostreet research team Cambridge, MA, USA), Yiru Veronika Wang (Robostreet research team Cambridge, MA, USA), Yihan Wang (Robostreet research team Cambridge, MA, USA), Zihao Li (Robostreet research team Cambridge, MA, USA), Xiaohui Liang (Robostreet research team Cambridge, MA, USA)
DriveOSS is a new real‑world multimodal dataset and benchmark for 3D anomaly segmentation and open‑set semantic segmentation in autonomous driving. It contains 12,661 synchronized frames from six RGB cameras, a 128‑beam LiDAR, and GPS/IMU, covering 52 driving scenes under various weather conditions. The data are split into in‑distribution (ID) scenes for training and out‑of‑distribution (OOD) scenes for validation and testing, with unknown objects labeled as an outlier class to challenge current 3D perception systems.
By Zhiran Yan, Savankumar Bhanderi, Sourabh Lolge, Rui Song, Girdharbhai Paneliya, Shiva Agrawal, Gordon Elger
arXiv:2608.13147v2 Announce Type: replace
Abstract: Camera-based autonomous driving perception requires a shared representation that preserves metric 3D structure across synchronized multi-camera str...
By Longfei Xu, Xiaohui Wang, Zehao Huang, Han Li, Ya Yang, Naiyan Wang, Si Liu