arXiv AI

Jev with Foresight: Safe Language-Guided Autonomous Driving via a Language World Model

Jev-AD combines a typed decision model, Jev, with a language world model to predict how nearby vehicles will move over the next two seconds for each candidate action. By comparing these predictions to the decision model’s outputs, Jev-AD reduces collision rates dramatically in both simulated highway merging (from 26.0% to 2.4%) and real‑world NGSIM episodes (from 48.2% to 2.8%). The system also achieves passenger intent in 93% of free‑form command trials and foresees 93% of dangerous actions in real traffic.

arXiv Computer Vision
Sep 30

CAR-VLA: Complexity-Aware and Risk-Adaptive Reasoning for Autonomous Driving

CAR‑VLA is a Vision‑Language‑Action model for autonomous driving that jointly considers scene complexity and dynamic risk to determine reasoning depth, urgency, and focus. It maps four complexity‑risk categories to three reasoning modes—Fast Intuition, Slow Thinking, and Reflex Response—each tailored to different driving scenarios. The model is trained via progressive supervised learning and reinforcement learning, achieving competitive performance on NAVSIM and Navhard benchmarks and demonstrating risk‑aware reasoning in high‑risk scenarios.

By Xiaolei Chen, Zhuolin He, Yuxuan Liang, Xu Li, Haotian Chen, Fan Shi, Mengyang Zhao, Wenjuan Meng, Zisheng Chen, Zhihao Zhu, Zhounan Jin, Hengli Wang, Qingfan Wang, Jiamei Liang, Bin Li, Xiangyang Xue
arXiv AI
Jun 2

From Segments to Scenes: Temporal Understanding in Autonomous Driving via Vision-Language Model

arXiv:2512. 05277v3 Announce Type: replace-cross Abstract: Vision-Language Models (VLMs) are increasingly deployed as the perception and reasoning backbone of autonomous agents acting in the wild, with autonomous driving (AD) being one of the most safety-critical instances.

By Kevin Cannons, Saeed Ranjbar Alvar, Mohammad Asiful Hossain, Ahmad Rezaei, Mohsen Gholami, Alireza Heidarikhazaei, Zhou Weimin, Yong Zhang, Mohammad Akbari
arXiv AI
Jun 4

From Segments to Scenes: Temporal Understanding for Agentic Autonomous Driving via Vision-Language Models

arXiv:2512. 05277v4 Announce Type: replace-cross Abstract: Vision-Language Models (VLMs) are increasingly deployed as the perception and reasoning backbone of autonomous agents acting in the wild, with autonomous driving (AD) being one of the most safety-critical instances.

By Kevin Cannons, Saeed Ranjbar Alvar, Mohammad Asiful Hossain, Ahmad Rezaei, Mohsen Gholami, Alireza Heidarikhazaei, Zhou Weimin, Yong Zhang, Mohammad Akbari
arXiv AI
Oct 26

DriveMind: Mind-Evolving Belief Tracking for Closed-Loop Autonomous Driving

DriveMind is a multimodal large language model (MLLM) framework for autonomous driving that maintains multiple hypotheses about a traffic scene and updates their weights as new frames arrive, inspired by particle filtering. By propagating each hypothesis through a vision-language model, scoring against current observations, and resampling to preserve diversity, DriveMind improves driving performance on the Bench2Drive benchmark, raising the Driving Score from 68.50 to 81.37 and the Success Rate from 41.36% to 54.09%. The approach yields the largest gains in ambiguous scenarios such as unsignalized intersections and oncoming-traffic interactions, and also enhances fine‑grained interactive driving tasks like merging, emergency braking, and give‑way.

By Yan Shi, Kehua Chen, Jiarui Qi, Yihong Tang, Haichen Liao, Yinhai Wang