arXiv Machine Learning

Testing Between the Test Cases: Proving End-to-End Steering in Conditions You Never Drove

The paper presents a study on using formal verification to assess end‑to‑end steering models for autonomous vehicles. Two small steering networks were trained in CARLA—one on clear conditions only and another on clear, fog, night, and low sun—and both were evaluated against a 2.19‑ft lane‑departure budget. By applying bound propagation, the authors computed steering drift across a vast range of disturbances, uncovering failures in the clear‑trained model that were not detected by simulation alone and suggesting potential failures between test cases.

arXiv Machine Learning
Sep 18

OPTED: On-Policy Fine-Tuning for End-to-End Driving using a Render-Free Teacher

OPTED is a method for on‑policy fine‑tuning of end‑to‑end driving models that separates reinforcement learning from the policy update. A privileged teacher trained with RL on vectorized inputs (HD‑maps and bounding boxes) supervises the pre‑trained student during closed‑loop post‑training. Applied to the camera‑based models TransFuser and VaVAM in AlpaSim, OPTED boosts driving scores by 1.6× and 9.5×, respectively, while requiring roughly three orders of magnitude fewer simulator interactions than direct RL post‑training.

By Damiano Da Col, Maximilian Igl, Peter Karkus, Kashyap Chitta, Boris Ivanovic, Marco Pavone, Konrad Schindler, Christos Sakaridis
arXiv AI
Oct 1

DrivingBench: Can Vision-Language Models Drive a Toyota Corolla?

DrivingBench is the first benchmark that tests general‑purpose vision‑language models on the task of driving a real Toyota Corolla around a parking‑lot cone course. The models receive live camera frames and issue steering and velocity commands, with inference latency counted as part of the challenge. In tests, only GPT‑6 Astra completed the course, while other models showed limited progress or failed to pass half the course.

By Aditya Ramabadran, Simon Mahns, Tobias Gessler
arXiv Computer Vision
Oct 1

TrafficSignBench: Rule-Centric Closed-Loop Evaluation of Traffic-Sign Compliance in Autonomous Driving

arXiv:2609.38463v1 Announce Type: cross Abstract: Autonomous driving planners are typically evaluated using aggregate metrics such as driving score, destination rate, and collision rate, which do not...

By Victoria Smirnova, Viktoriia Zinkovich, Gregorii Bukhtuev, Artem Belyaev, Andrey Kuznetsov, Denis Shepelev, Vlad Shakhuro
arXiv AI
Sep 4

A Low-Cost, Open Platform for End-to-End Autonomous Driving on a Miniature Ackermann Vehicle

The paper introduces a low‑cost, open experimental platform for end‑to‑end autonomous driving on miniature Ackermann vehicles, combining a physical car, printed track, data collection tools, trajectory registration, and a Webots digital twin. It implements command‑conditioned behavior cloning, achieving a mean cross‑track error of 6.1 cm on the real vehicle and demonstrating the impact of camera field of view in simulation. Using synthetic data from the digital twin and a sim‑to‑real image translator, a higher‑capacity policy trained on both synthetic and real data completes all four track routes, outperforming the baseline trained only on real data.

By Gustavo Claudio Karl Couto, Eric Aislan Antonelo, Gabriel George Zipperer
arXiv AI
Sep 28

Guiding End-to-End Driving Models with Endpoint-Constrained Trajectory Optimization

The paper introduces Endpoint-Constrained Optimization (ECO), a lightweight postprocessing layer that corrects intermediate waypoints of end-to-end driving policies while preserving the predicted endpoint. ECO does not require maps, privileged simulator state, or additional training, and can be applied to a wide range of waypoint-emitting policies. Experiments on two closed-loop simulators show that ECO significantly improves closed-loop performance, achieving top results in the HUGSIM Closed-Loop Driving Challenge and boosting scene scores on AlpaSim.

By Brayden Zhang, Mahsa Golchoubian, Igor Gilitschenski, Boris Ivanovic, Kashyap Chitta
arXiv Computer Vision
Aug 28

Beyond the Proving Ground: Independent Public-Road Testing of Assisted Lane Change Systems using LiDAR

This study introduces a method for independently testing Assisted Lane Change (ALC) systems on public roads using LiDAR-based vehicle detection and tracking. A campaign on the A31 French motorway evaluated 27 lane‑change maneuvers, finding that 18 were completed, 9 were suppressed, and in six cases the system permitted maneuvers that violated regulatory minimum distance requirements. The results confirm LiDAR’s suitability for such assessments and provide a framework that can aid market surveillance and future regulatory updates.

By Marcello Cellina, Akos Kriston, Antonio Migneco, Davide Maggi, Stefano Favelli, Fabrizio Re, Fabrizio Minarini, Andrea Nuovo, Riccardo Dona, Biagio Ciuffo
arXiv AI
Jun 17

DriveJudge: Rethinking Autonomous Driving Evaluation with Vision-Language Models

arXiv:2606. 17362v1 Announce Type: cross Abstract: Autonomous driving has shifted towards end-to-end policy learning, where reliable, interpretable policy evaluation is a fundamental challenge as driving quality is highly context-dependent.

By Xinglong Sun, Kevin Xie, Jenny Schmalfuss, Despoina Paschalidou, Xiuming Zhang, Sanja Fidler, Kashyap Chitta, Jose M. Alvarez
arXiv AI
Sep 17

Imitation Learning for Autonomous Driving in CARLA

The paper presents a compact multimodal policy trained via behavioral cloning to drive autonomously in the CARLA simulator. Using five‑frame histories of RGB images, LiDAR, telemetry, and lane waypoints, the 1.36‑million‑parameter model predicts throttle, brake, and steering at 20 Hz. Trained on 236,882 windows (≈3.3 hours of driving) from 448 captures, the policy drives for hours on both training and unseen routes without collisions, demonstrating qualitative transfer and recovery from large trajectory deviations.

By Jordy Kieto