arXiv AI
5d ago

DriveWLA: Unifying Future Dynamics and Scene Semantics through World-Language-Action Modeling for Autonomous Driving

DriveWLA is a unified World‑Language‑Action model that integrates semantic understanding, future scene dynamics, and trajectory generation for autonomous driving. It employs a Mixture‑of‑Transformers architecture with three experts—World, Language, and Action—connected by Cross‑Expert Attention to align semantic and dynamic representations. After reinforcement learning refinement, DriveWLA outperforms existing VLM‑based and world‑model‑based planners on NAVSIM benchmarks and generalizes well to other datasets without fine‑tuning.

By Shuzheng Wang, Haoxuan Li, Shengzhen Li, Chenxi Wu, Yajing Sun, Lu Hou, Wenyu Liu, Xinggang Wang
arXiv Computer Vision
Oct 12

FPD-Drive: Future Policy Distillation for End-to-End Autonomous Driving

FPD-Drive is an end‑to‑end autonomous driving planner that uses future‑privileged multi‑target distillation to transfer diverse, high‑quality trajectory targets from a teacher model with access to future observations to a student policy. It also introduces safety‑aware score correction to improve candidate selection by adjusting rankings between safe and unsafe trajectories. The approach achieves state‑of‑the‑art performance on NAVSIM v1 and v2 benchmarks and demonstrates strong zero‑shot closed‑loop results on HUGSIM.

By Li-Heng Chen, Qifeng Chen, Chengwei Wu, Yingjie Zhang, Sheng Yang, Hongbo Fu, Shaoqing Ren
arXiv AI
Jun 12

PersonaDrive: Human-Style Retrieval-Augmented VLA Agents for Closed-Loop Driving Simulation

arXiv:2606. 12616v1 Announce Type: new Abstract: Closed-loop driving simulators typically populate their environments with non-ego traffic agents that behave largely the same way, produced either by rule-based traffic managers or by learned models trained toward a single behavioral mode.

By Mahmoud Srewa, Praneetsai Iddamsetty, Mohammad Abdullah Al Faruque, Salma Elmalaki
arXiv Computer Vision
5d ago

VITAL: From Visual Motion to Precise Action

arXiv:2610.20604v1 Announce Type: new Abstract: World-action models aim to turn visual anticipation into driving decisions, yet typically train action experts on trajectory representations defined in...

By Ao Liang, Youquan Liu, Mingxiao Li, Wei Chow, Lingdong Kong, Yue Liao, Dongyue Lu, Yu Yang, Wei Yin, Runnan Chen