arXiv Machine Learning

Dream to Assist: Intent-Conditioned World Models for Shared Vehicle Control

Dream2Assist is a model‑based reinforcement learning framework that extends a recurrent state‑space world model with intent inference to support shared vehicle control. The system is trained via fictitious co‑play to anticipate discrete human objectives without overriding agency, and includes a full deployment pipeline to translate the policy into a safe, human‑centered real‑world system. Validation through three human‑subject studies and on‑vehicle deployments in high‑speed racing and urban driving shows that intent conditioning improves torque alignment and reduces collision rates.

arXiv AI
Jul 24

Drive As You Like: Multi-Head Diffusion with Reinforcement Learning for Personalized Driving

arXiv:2508. 16947v2 Announce Type: replace-cross Abstract: Despite significant progress, imitation learning-based autonomous driving planners remain largely restricted to reproducing high-frequency biased behaviors, overlooking the inherent behavioral diversity of human driving.

By Fan Ding, Xuewen Luo, Fucai Ke, Hwa Hui Tew, Susilawati Susilawati, Vishnu Monn Baskaran, Junn Yong Loo
arXiv AI
Jul 3

DriveVLM-RL: Neuroscience-Inspired Reinforcement Learning with Vision-Language Models for Safe and Deployable Autonomous Driving

arXiv:2603. 18315v2 Announce Type: replace-cross Abstract: Traditional reinforcement learning (RL) methods rely on manually engineered rewards or sparse collision signals, which fail to capture the rich contextual understanding required for safe driving and make unsafe exploration unavoidable in real-world settings.

By Zilin Huang, Zihao Sheng, Zhengyang Wan, Yansong Qu, Junwei You, Sicong Jiang, Sikai Chen
arXiv Machine Learning
Jun 16

CoIRL-AD: Collaborative-Competitive Imitation-Reinforcement Learning in Latent World Models for Autonomous Driving

arXiv:2510. 12560v2 Announce Type: replace-cross Abstract: End-to-end autonomous driving models trained with imitation learning (IL) often generalize poorly, particularly in long-tail scenarios where expert demonstrations are sparse.

By Xiaoji Zheng, Ziyuan Yang, Yanhao Chen, Yuhang Peng, Yuanrong Tang, Gengyuan Liu, Bokui Chen, Jiangtao Gong
arXiv Machine Learning
5d ago

IntNet: A Communication-Driven Multi-Agent Reinforcement Learning Framework for Cooperative Autonomous Driving

IntNet is a multi-agent reinforcement learning framework designed to improve safety in autonomous driving by integrating vehicle intent transmission and adaptive communication scheduling into a single end-to-end learning system. The model uses an observation prediction module for agents to forecast future policy outputs and share them over a vehicle-to-vehicle network, while a Graph Attention Network processes incoming messages and a scheduler optimizes the communication graph for bandwidth efficiency. Experiments in complex urban environments show that IntNet achieves better coordination, lower collision rates, and reduces communication effort by up to 60% compared to state‑of‑the‑art communicative MARL methods.

By Leandro Parada, Kevin Yu, Panagiotis Angeloudis
arXiv AI
Oct 15

DriveWLA: Unifying Future Dynamics and Scene Semantics through World-Language-Action Modeling for Autonomous Driving

DriveWLA is a unified World‑Language‑Action model that integrates semantic understanding, future scene dynamics, and trajectory generation for autonomous driving. It employs a Mixture‑of‑Transformers architecture with three experts—World, Language, and Action—connected by Cross‑Expert Attention to align semantic and dynamic representations. After reinforcement learning refinement, DriveWLA outperforms existing VLM‑based and world‑model‑based planners on NAVSIM benchmarks and generalizes well to other datasets without fine‑tuning.

By Shuzheng Wang, Haoxuan Li, Shengzhen Li, Chenxi Wu, Yajing Sun, Lu Hou, Wenyu Liu, Xinggang Wang
arXiv Machine Learning
Jul 17

Human-In-The-Loop Machine Learning for Safe and Ethical Autonomous Vehicles: Principles, Challenges, and Opportunities

arXiv:2408. 12548v3 Announce Type: replace Abstract: Machine Learning (ML) has become central to Autonomous Vehicles (AVs), supporting perception, prediction, planning, control, and decision-making in dynamic environments.

By Yousef Emami, Mohammadhossein Homaei, Miguel Guti\'errez Gait\'an, Luis Almeida, Kai Li, Hui Huang, Zhu Han
arXiv AI
Aug 12

Threat-guided Policy-aware Scene Perturbation for Safe Autonomous Driving with Online Reinforcement Learning

arXiv:2608. 10403v1 Announce Type: new Abstract: Reinforcement learning (RL) has shown promising performance in autonomous driving, yet ensuring the safety of online RL policies remains challenging due to insufficient exposure to safety-critical driving scenes.

By Xincong Hu (Nanjing University), Lei Ou (Nanjing University), Maosen Li (Yinwang Intelligent Technology Co., Ltd), Jingtao Zhang (Yinwang Intelligent Technology Co., Ltd), Liguo Hou (Yinwang Intelligent Technology Co., Ltd), Zongzhang Zhang (Nanjing University)
arXiv Machine Learning
Oct 8

Beyond Policy Support: Interaction Constrained Offline Reinforcement Learning for Autonomous Driving

The paper introduces Interaction-Constrained Drive Policy (ICDP), an offline reinforcement learning framework for autonomous driving that explicitly controls interaction-level distribution shift. ICDP decomposes joint-support degradation into ego-support and interaction-support components, estimating the latter via contrastive density-ratio estimation without requiring joint-density modeling or simulator rollouts. Experiments on nuPlan, Interplan, and real-world truck data demonstrate that ICDP reduces selection of high-value but interaction-unsupported trajectories and improves performance in interaction-critical driving scenarios.

By Mahmoud Selim, Cristina Cipriani, Karl Henrik Johansson