arXiv Computer Vision

TerrainForge: Physics-Grounded road geometry Editing for Counterfactual Autonomous Driving

Hugging Face Trending Papers
Jul 18

What Do They See? Interpreting Complex Road Scenarios Through the Eyes of Vision-Language-Action Models for Safe and Trustworthy Autonomous Vehicle Learning

End-to-end autonomous driving models are now able to navigate complex road scenarios, mapping raw sensor observations directly to observed paths for open-loop evaluation and often effective driving in closed-loop evaluation. Yet the internal logic of these safety-critical systems remains largely opaque, due to the complexity of traffic scenes.

arXiv AI
Jul 21

What Do They See? Interpreting Complex Road Scenarios Through the Eyes of Vision-Language-Action Models for Safe and Trustworthy Autonomous Vehicle Learning

arXiv:2607. 16938v1 Announce Type: cross Abstract: End-to-end autonomous driving models are now able to navigate complex road scenarios, mapping raw sensor observations directly to observed paths for open-loop evaluation and often effective driving in closed-loop evaluation.

By Kalpana Panda, Wesley Maia, Vinti Agarwal, Ross Greer
arXiv Computer Vision
Sep 18

WZPlanner: Safe End-to-End Path Planning for Autonomous Driving in Work Zones

The paper introduces WZPlanner, a new dataset and model for safe autonomous driving in work zones. The dataset, WorkZonePlan, contains over 149,000 synthetic and 5,000 real-world samples with 3D annotations for lane and work zone boundaries, plus 228 evaluation routes in CARLA. The proposed BoundaryFormer (BF) and its enhanced BF++ variants jointly predict lane/work‑zone boundaries and driving trajectories, achieving higher Driving Scores while being significantly smaller than competing models.

By Nishad Sahu (Raj), Changzhong Qian (Raj), Guangzhou Cai (Raj), Shounak Sural (Raj), Ragunathan (Raj), Rajkumar
arXiv AI
Sep 28

TrafficImag: A Benchmark for Counterfactual Roadside Traffic Video Generation

TrafficImag is the first benchmark designed to evaluate counterfactual roadside traffic video generation, combining a large roadside dataset with an executable protocol that supports behavior reasoning, intervention-aware image editing, and conditional video generation. Each intervention is encoded as an actor-level program specifying target actor, intended behavior, legal route, interaction order, and temporal constraints, allowing a unified evaluation across diverse foundation models. The benchmark assesses four validity dimensions—initial-state correctness, route and behavior validity, interaction consistency, and non-target preservation—and reports that the best models achieve 80.4% macro F1 for reasoning and 55.0% end-to-end success when using a complete condition interface.

By Xiangyu Li, Tianyi Wang, Zhihao Dou, Christian Claudel, Zhaomiao Guo
arXiv AI
Sep 2

CoLT-Drive: Counterfactual Long-Tail Benchmarking and Knowledge-Preserving Adaptation for Driving Affordance Prediction

The paper introduces CoLT-Drive, a 3,536-sample counterfactual long‑tail benchmark for evaluating decision‑level driving affordance prediction, which tests whether models can infer how rare objects affect an ego vehicle’s high‑level actions. It also proposes KPA, a knowledge‑preserving adaptation framework that combines structured prompting, expert merging, and a regime‑aware LoRA mixture‑of‑experts module to improve small VLMs on driving tasks. Experiments show KPA achieves 60.8% pair accuracy on CoLT‑Drive, outperforming the Qwen3‑VL‑2B baseline and LoRA SFT while keeping competitive in‑domain performance.

By Zhengxu Tang, Guofeng Cui, Ziyu Gong, Xiaozhou Zhang, Ruifeng Deng, Chengzhi Qi, Ke Chen, Sachin Patil, Tianjun Xiao, Langechuan Liu, Pichao Wang