arXiv Computer Vision

Autonomous Driving Research Requires a Community-Driven Data Paradigm

arXiv Machine Learning
Jun 3

The Road Ahead in Autonomous Driving: The KITScenes Multimodal Dataset

arXiv:2606. 02956v1 Announce Type: cross Abstract: Existing autonomous driving datasets have enabled major progress, but fall short in sensor fidelity, map completeness, or geographic diversity.

By Richard Schwarzkopf, Fabian Immel, Alexander Blumberg, Jonas Merkert, Nils Rack, Kaiwen Wang, Fabian Konstantinidis, Julian Truetsch, Carlos Fernandez, Annika B\"atz, Kevin R\"osch, Marlon Steiner, Willi Poh, Yinzhe Shen, Royden Wagner, Felix Hauser, Dominik Strutz, Jaime Villa, Gleb Stepanov, Holger Caesar, \"Omer \c{S}ahin Ta\c{s}, Frank Bieder, Jan-Hendrik Pauls, Christoph Stiller
arXiv AI
Jul 2

Creating Impactful Autonomous Driving Datasets: A Strategic Guide from Research Gap to Benchmark

arXiv:2607. 00710v1 Announce Type: cross Abstract: Well-designed autonomous driving datasets have fundamentally shaped research progress, yet existing literature primarily describes what datasets contain rather than how to strategically design impactful ones.

By Richard Schwarzkopf, Jonas Merkert, Frank Bieder, Annika B\"atz, Alexander Blumberg, Carlos Fernandez, Felix Hauser, Fabian Immel, Christian Kinzig, Hendrik K\"onigshof, Fabian Konstantinidis, Martin Lauer, Willi Poh, Nils Rack, Kevin R\"osch, Yinzhe Shen, Marlon Steiner, Gleb Stepanov, Dominik Strutz, \"Omer \c{S}ahin Ta\c{s}, Julian Truetsch, Kaiwen Wang, Royden Wagner, Jan-Hendrik Pauls, Christoph Stiller
Hugging Face Trending Papers
Aug 18

Plug-and-Play Traffic Element Awareness for End-to-End Autonomous Driving

The paper introduces a plug‑and‑play method that injects traffic‑element signals—such as traffic lights and road signs—into end‑to‑end autonomous driving models with minimal architectural changes. By augmenting several public datasets with comprehensive traffic‑element annotations, the authors evaluate this integration across diverse driving paradigms, consistently improving performance on nuScenes, NAVSIM‑v1, NAVSIM‑v2, and Bench2Drive. The approach achieves a new state‑of‑the‑art result on the challenging NAVSIM‑v2 benchmark, demonstrating the broad utility of traffic‑element awareness.

arXiv Computer Vision
Oct 2

A Survey on End-to-End Autonomous Driving Training from the Perspectives of Data, Strategy, and Platform

The paper reviews end‑to‑end autonomous driving (E2E‑AD) training, framing it as a Data‑Strategy‑Platform system. It surveys recent advances in data pipelines, learning paradigms, and training infrastructures, and discusses how these layers interact to influence model performance, robustness, and deployability. The authors highlight current limitations and propose a future vision that prioritizes data value, foundation‑driven generalization, and integrated training‑testing loops for more robust, scalable, and trustworthy autonomous driving systems.

By Chengkai Xu, Yiming Cui, Jiaqi Liu, Yicheng Guo, Cheng Qin, Geyuan Zhang, Xinwei Dong, Shiyu Fang, Peng Hang, Jian Sun
arXiv AI
Jun 10

TaCarla: A comprehensive benchmarking dataset for end-to-end autonomous driving

arXiv:2602. 23499v4 Announce Type: replace-cross Abstract: Collecting a high-quality dataset is a critical task that demands meticulous attention to detail, as overlooking certain aspects can render the entire dataset unusable.

By Tugrul Gorgulu, Atakan Dag, M. Esat Kalfaoglu, Halil Ibrahim Kuru, Baris Can Cam, Halil Ibrahim Ozturk, Ozsel Kilinc
arXiv AI
Jul 3

Autonomous discovery of traffic laws with AI traffic scientists

arXiv:2607. 01639v1 Announce Type: new Abstract: Universal traffic laws describe recurrent patterns in congestion, mobility and driving behavior across cities, providing a scientific basis for transportation planning, management and control.

By Xingyuan Dai, Yue Liu, Xiaoyan Gong, Qinghai Miao, Junyou Shang, Yutong Wang, Chao Guo, Yonglin Tian, Yizhang Chai, Chao Xiang, Yisheng Lv, Fei-Yue Wang
arXiv Computer Vision
Oct 8

Generative AI for Autonomous Driving: Frontiers and Opportunities

arXiv:2505.08854v2 Announce Type: replace Abstract: Generative Artificial Intelligence (GenAI) constitutes a transformative technological wave that reconfigures industries through its unparalleled ca...

By Yuping Wang, Shuo Xing, Cui Can, Renjie Li, Hongyuan Hua, Kexin Tian, Zhaobin Mo, Xiangbo Gao, Keshu Wu, Sulong Zhou, Hengxu You, Juntong Peng, Junge Zhang, Zehao Wang, Rui Song, Mingxuan Yan, Walter Zimmer, Xingcheng Zhou, Peiran Li, Fangzhou Lin, Peizheng Li, Zhaohan Lu, Chia-Ju Chen, Yue Huang, Ryan A. Rossi, Lichao Sun, Hongkai Yu, Zhiwen Fan, Frank Hao Yang, Yuhao Kang, Ross Greer, Chenxi Liu, Eun Hak Lee, Xuan Di, Xinyue Ye, Liu Ren, Alois Knoll, Xiaopeng Li, Shuiwang Ji, Masayoshi Tomizuka, Marco Pavone, Tianbao Yang, Jing Du, Ming-Hsuan Yang, Hua Wei, Ziran Wang, Yang Zhou, Jiachen Li, Zhengzhong Tu
arXiv Computer Vision
2d ago

nuReasoning: A Reasoning-Centric Dataset and Benchmark for Long-Tail Autonomous Driving

nuReasoning is a large‑scale, real‑world dataset and benchmark designed to advance reasoning‑centric autonomous driving in long‑tail scenarios. It contains 20,000 twenty‑second clips from multiple cities, each annotated with synchronized multi‑camera images, LiDAR, HD maps, object labels, and human‑verified reasoning labels covering spatial, decision, and counterfactual reasoning. The benchmark supports both reasoning evaluation and planning evaluation, demonstrating that fine‑tuning vision‑language models on nuReasoning improves question answering and that reasoning supervision boosts planning performance even without textual outputs at inference time.

By Zhiyu Huang, Johnson Liu, Rui Song, Xuewei Qi, Yiluan Guo, Zewei Zhou, Hanyin Zhang, Mingxuan Gao, Valeria Xu, Jiali Chen, Yun Zhang, Tianhui Cai, Ruining Yang, Yishan Shen, Jiaqi Ma
arXiv AI
Sep 21

Benchmarking Autonomous Driving Planners Across Leaderboards: A Unified CARLA-Based Evaluation

The paper presents a comparative study of motion planning methods from major autonomous driving benchmarks—CARLA, nuPlan, and the Waymo Open Dataset—using CARLA Leaderboard v2.1 as a unified evaluation platform. Eight representative planners (TF++, InterFuser, TCP, PDM‑Lite, MTR+MPC, CaRL, PlanT 2.0, Diffusion planner) are evaluated to highlight their strengths, weaknesses, prevailing trends, and common challenges in motion planning research.

By Merve Atasever, Alfredo Reina Corona, Zhuochen Liu, Qingpei Li, Akshay Hitendra Shah, Hans Walker, Jyotirmoy V. Deshmukh, Rahul Jain
arXiv Machine Learning
Oct 23

Learning to Drive in New Cities Without Human Demonstrations

The paper presents NOMAD, a method that uses self‑play multi‑agent reinforcement learning to adapt autonomous driving policies to new cities without any human demonstration data from those cities. By leveraging only the target city’s map and meta‑information, NOMAD improves task success rates and trajectory realism in simulation, offering a scalable alternative to data‑intensive city‑transfer approaches. The approach demonstrates that reliable driving can be achieved in substantially different urban environments through map‑based self‑play.

By Zilin Wang, Saeed Rahmani, Daphne Cornelisse, Bidipta Sarkar, Alexander David Goldie, Jakob Nicolaus Foerster, Shimon Whiteson