arXiv Computer Vision By Rajeev Yasarla, Deepti Hegde, Hsin-Pai Cheng, Shizhong Han, Yunxiao Shi, Meysam Sadeghigooghari, Hanno Ackermann, Litian Liu, Pranav Desai, Fatih Porikli, Mohammad Ghavamzadeh, Hong Cai

MAPLE: Latent Multi-Agent Play for End-to-End Autonomous Driving

Read the original on arXiv Computer Vision →

MAPLE is a new framework that enables reactive, multi‑agent rollout of dynamic driving scenarios directly in the latent space of vision‑language‑action models. It trains the ego vehicle and surrounding traffic agents independently over multiple steps, using supervised fine‑tuning followed by reinforcement learning with safety, progress, and interaction rewards. The approach is scalable, does not rely on external simulators, and achieves state‑of‑the‑art performance on Bench2Drive.

Machine-generated by The Flow from the publisher's headline and feed description — not written or checked by a human. The full article lives at arXiv Computer Vision.

arXiv Computer Vision
Sep 30

RoXDrive: Closed-Loop Reinforcement Learning for End-to-End Autonomous Driving via Action-Faithful Rollouts

arXiv:2609.36851v1 Announce Type: new Abstract: End-to-end autonomous driving policies are commonly trained via imitation learning on logged demonstrations without observing the consequences of their...

By Hongbin Lin, Chaoda Zheng, Yiming Yang, Xiangyu Li, Shijia Chen, Jinhao Deng, Kangjie Chen, Dongbin Zhang, Jie Feng, Yu Zhang, Xianming Liu, Shuguang Cui, Boyang Wang, Zhen Li
arXiv Computer Vision
6d ago

Generative Scenario Rollouts for End-to-End Autonomous Driving

Generative Scenario Rollouts (GeRo) is a plug‑and‑play framework that augments Vision‑Language‑Action models for autonomous driving by jointly planning and generating language‑grounded future traffic scenes through an autoregressive rollout strategy. The approach trains a VLA model to encode vehicle and agent dynamics into latent tokens, then uses language‑conditioned autoregressive generation to produce future latent tokens and textual responses, with a rollout‑consistency loss to maintain temporal coherence and text‑action alignment. On the Bench2Drive benchmark, GeRo improves driving score by +15.7 and success rate by +26.2, and achieves state‑of‑the‑art closed‑loop and open‑loop performance, demonstrating strong zero‑shot robustness.

By Rajeev Yasarla, Deepti Hegde, Shizhong Han, Hsin-Pai Cheng, Yunxiao Shi, Meysam Sadeghigooghari, Shweta Mahajan, Apratim Bhattacharyya, Litian Liu, Risheek Garrepalli, Thomas Svantesson, Fatih Porikli, Mohammad Ghavamzadeh, Hong Cai
arXiv AI
Aug 11

CMU-Drive and V2V-VLA: Cooperative Multi-agent Unified Driving with Reasoning Benchmark and Vehicle-to-Vehicle Vision-Language-Action Models

arXiv:2608. 07621v1 Announce Type: new Abstract: Vision-Language-Action (VLA) models have recently achieved impressive performance for end-to-end autonomous driving, yet existing approaches are primarily designed for an individual single autonomous driving agent with limited support for cooperative perception, reasoning, and planning.

By Hsu-kuang Chiu, Stephen F. Smith
arXiv Computer Vision
Oct 1

Vision-Language-Action Autonomous Driving Agent with Language-based Memory

arXiv:2609.38641v1 Announce Type: new Abstract: Vision-Language-Action (VLA) foundation models have recently emerged as one of the prevailing solutions for autonomous driving, as they can utilize kno...

By Kai Yan, Xiangyu Chen, Yulong Cao, Alex Naumann, Peter Karkus, Yan Wang, Jef Packer, Alex Schwing, Yuxiong Wang, Boris Ivanovic, Wenjie Luo, Marco Pavone
arXiv Computer Vision
Oct 28

Closed-Loop Aware Planning via Imitation-Free Speed Scoring for End-to-End Autonomous Driving

The paper introduces Closed-Loop Aware Planning for Autonomous Driving (CLAP‑AD), a new planning head that learns a driving path via imitation while independently scoring candidate speeds using a learned function guided by safety constraints. Unlike traditional open‑loop imitation learning, CLAP‑AD allows explicit test‑time control over speed selection without requiring speed‑conditioned training. Experiments on Bench2Drive‑Speed, Bench2Drive, and NAVSIM v2 demonstrate significant improvements in speed‑adherence and overall driving performance compared to state‑of‑the‑art baselines.

By Emad Aghajanzadeh, Thomas Schwarzfischer, Marc Kaufeld, Moritz Thoma, Ryan P\'egoud, Manoj Rohit Vemparala, Pierpaolo Mori, Nael Fasfous, Johannes Betz, Daniel Mueller-Gritschneder, Ulf Schlichtmann