arXiv Computer Vision

MAPLE: Latent Multi-Agent Play for End-to-End Autonomous Driving

MAPLE is a new framework that enables reactive, multi‑agent rollout of dynamic driving scenarios directly in the latent space of vision‑language‑action models. It trains the ego vehicle and surrounding traffic agents independently over multiple steps, using supervised fine‑tuning followed by reinforcement learning with safety, progress, and interaction rewards. The approach is scalable, does not rely on external simulators, and achieves state‑of‑the‑art performance on Bench2Drive.

arXiv Computer Vision
Sep 30

RoXDrive: Closed-Loop Reinforcement Learning for End-to-End Autonomous Driving via Action-Faithful Rollouts

arXiv:2609.36851v1 Announce Type: new Abstract: End-to-end autonomous driving policies are commonly trained via imitation learning on logged demonstrations without observing the consequences of their...

By Hongbin Lin, Chaoda Zheng, Yiming Yang, Xiangyu Li, Shijia Chen, Jinhao Deng, Kangjie Chen, Dongbin Zhang, Jie Feng, Yu Zhang, Xianming Liu, Shuguang Cui, Boyang Wang, Zhen Li
arXiv Computer Vision
6d ago

Generative Scenario Rollouts for End-to-End Autonomous Driving

Generative Scenario Rollouts (GeRo) is a plug‑and‑play framework that augments Vision‑Language‑Action models for autonomous driving by jointly planning and generating language‑grounded future traffic scenes through an autoregressive rollout strategy. The approach trains a VLA model to encode vehicle and agent dynamics into latent tokens, then uses language‑conditioned autoregressive generation to produce future latent tokens and textual responses, with a rollout‑consistency loss to maintain temporal coherence and text‑action alignment. On the Bench2Drive benchmark, GeRo improves driving score by +15.7 and success rate by +26.2, and achieves state‑of‑the‑art closed‑loop and open‑loop performance, demonstrating strong zero‑shot robustness.

By Rajeev Yasarla, Deepti Hegde, Shizhong Han, Hsin-Pai Cheng, Yunxiao Shi, Meysam Sadeghigooghari, Shweta Mahajan, Apratim Bhattacharyya, Litian Liu, Risheek Garrepalli, Thomas Svantesson, Fatih Porikli, Mohammad Ghavamzadeh, Hong Cai
arXiv AI
Aug 11

CMU-Drive and V2V-VLA: Cooperative Multi-agent Unified Driving with Reasoning Benchmark and Vehicle-to-Vehicle Vision-Language-Action Models

arXiv:2608. 07621v1 Announce Type: new Abstract: Vision-Language-Action (VLA) models have recently achieved impressive performance for end-to-end autonomous driving, yet existing approaches are primarily designed for an individual single autonomous driving agent with limited support for cooperative perception, reasoning, and planning.

By Hsu-kuang Chiu, Stephen F. Smith
arXiv Computer Vision
Oct 1

Vision-Language-Action Autonomous Driving Agent with Language-based Memory

arXiv:2609.38641v1 Announce Type: new Abstract: Vision-Language-Action (VLA) foundation models have recently emerged as one of the prevailing solutions for autonomous driving, as they can utilize kno...

By Kai Yan, Xiangyu Chen, Yulong Cao, Alex Naumann, Peter Karkus, Yan Wang, Jef Packer, Alex Schwing, Yuxiong Wang, Boris Ivanovic, Wenjie Luo, Marco Pavone
arXiv Computer Vision
Oct 28

Closed-Loop Aware Planning via Imitation-Free Speed Scoring for End-to-End Autonomous Driving

The paper introduces Closed-Loop Aware Planning for Autonomous Driving (CLAP‑AD), a new planning head that learns a driving path via imitation while independently scoring candidate speeds using a learned function guided by safety constraints. Unlike traditional open‑loop imitation learning, CLAP‑AD allows explicit test‑time control over speed selection without requiring speed‑conditioned training. Experiments on Bench2Drive‑Speed, Bench2Drive, and NAVSIM v2 demonstrate significant improvements in speed‑adherence and overall driving performance compared to state‑of‑the‑art baselines.

By Emad Aghajanzadeh, Thomas Schwarzfischer, Marc Kaufeld, Moritz Thoma, Ryan P\'egoud, Manoj Rohit Vemparala, Pierpaolo Mori, Nael Fasfous, Johannes Betz, Daniel Mueller-Gritschneder, Ulf Schlichtmann
arXiv Machine Learning
Oct 22

DriveMLP: When Training Strategy Outperforms Model Complexity in Autonomous Driving

The paper introduces DriveMLP, a lightweight MLP policy for autonomous driving that is trained using an Expert‑Guided RL (EGRL) framework. EGRL leverages reinforcement learning solely as an optimization tool, guided by a trajectory‑distance reward derived from logged expert data, and the study shows that the training strategy itself yields significant performance gains over model complexity. DriveMLP achieves an 86.51 score on the nuPlan Val14 Reactive benchmark, surpassing the previous best IL planner by 3.2 points while offering more than 15× faster inference.

By Alessandro Canevaro, Julian Schmidt, Hang Yu, Ye Jin, Sajad Marvi, Georg Martius, Julian Jordan
arXiv AI
Oct 15

DriveWLA: Unifying Future Dynamics and Scene Semantics through World-Language-Action Modeling for Autonomous Driving

DriveWLA is a unified World‑Language‑Action model that integrates semantic understanding, future scene dynamics, and trajectory generation for autonomous driving. It employs a Mixture‑of‑Transformers architecture with three experts—World, Language, and Action—connected by Cross‑Expert Attention to align semantic and dynamic representations. After reinforcement learning refinement, DriveWLA outperforms existing VLM‑based and world‑model‑based planners on NAVSIM benchmarks and generalizes well to other datasets without fine‑tuning.

By Shuzheng Wang, Haoxuan Li, Shengzhen Li, Chenxi Wu, Yajing Sun, Lu Hou, Wenyu Liu, Xinggang Wang
arXiv Machine Learning
Jul 22

End-to-end Conditional Diffusion for Realistic and Controllable Visual Traffic Scenario Generation

arXiv:2607. 18637v1 Announce Type: cross Abstract: Generating closed-loop traffic scenarios that are both realistic and controllable is crucial for evaluating autonomous driving systems, especially under rare safety-critical interactions.

By Jingzheng Li, Yufei Ge, Zhijun Chen, Qianren Mao, Zizhe Wang, Binhang Qi, Bing Li, Keyu Chen, Baochang Zhang, Xianglong Liu, Philip S Yu