arXiv Machine Learning

OPTED: On-Policy Fine-Tuning for End-to-End Driving using a Render-Free Teacher

OPTED is a method for on‑policy fine‑tuning of end‑to‑end driving models that separates reinforcement learning from the policy update. A privileged teacher trained with RL on vectorized inputs (HD‑maps and bounding boxes) supervises the pre‑trained student during closed‑loop post‑training. Applied to the camera‑based models TransFuser and VaVAM in AlpaSim, OPTED boosts driving scores by 1.6× and 9.5×, respectively, while requiring roughly three orders of magnitude fewer simulator interactions than direct RL post‑training.

arXiv Computer Vision
6d ago

Closed-Loop Aware Planning via Imitation-Free Speed Scoring for End-to-End Autonomous Driving

The paper introduces Closed-Loop Aware Planning for Autonomous Driving (CLAP‑AD), a new planning head that learns a driving path via imitation while independently scoring candidate speeds using a learned function guided by safety constraints. Unlike traditional open‑loop imitation learning, CLAP‑AD allows explicit test‑time control over speed selection without requiring speed‑conditioned training. Experiments on Bench2Drive‑Speed, Bench2Drive, and NAVSIM v2 demonstrate significant improvements in speed‑adherence and overall driving performance compared to state‑of‑the‑art baselines.

By Emad Aghajanzadeh, Thomas Schwarzfischer, Marc Kaufeld, Moritz Thoma, Ryan P\'egoud, Manoj Rohit Vemparala, Pierpaolo Mori, Nael Fasfous, Johannes Betz, Daniel Mueller-Gritschneder, Ulf Schlichtmann
arXiv Computer Vision
Oct 12

FPD-Drive: Future Policy Distillation for End-to-End Autonomous Driving

FPD-Drive is an end‑to‑end autonomous driving planner that uses future‑privileged multi‑target distillation to transfer diverse, high‑quality trajectory targets from a teacher model with access to future observations to a student policy. It also introduces safety‑aware score correction to improve candidate selection by adjusting rankings between safe and unsafe trajectories. The approach achieves state‑of‑the‑art performance on NAVSIM v1 and v2 benchmarks and demonstrates strong zero‑shot closed‑loop results on HUGSIM.

By Li-Heng Chen, Qifeng Chen, Chengwei Wu, Yingjie Zhang, Sheng Yang, Hongbo Fu, Shaoqing Ren
arXiv AI
Sep 28

Guiding End-to-End Driving Models with Endpoint-Constrained Trajectory Optimization

The paper introduces Endpoint-Constrained Optimization (ECO), a lightweight postprocessing layer that corrects intermediate waypoints of end-to-end driving policies while preserving the predicted endpoint. ECO does not require maps, privileged simulator state, or additional training, and can be applied to a wide range of waypoint-emitting policies. Experiments on two closed-loop simulators show that ECO significantly improves closed-loop performance, achieving top results in the HUGSIM Closed-Loop Driving Challenge and boosting scene scores on AlpaSim.

By Brayden Zhang, Mahsa Golchoubian, Igor Gilitschenski, Boris Ivanovic, Kashyap Chitta
arXiv AI
Aug 12

Threat-guided Policy-aware Scene Perturbation for Safe Autonomous Driving with Online Reinforcement Learning

arXiv:2608. 10403v1 Announce Type: new Abstract: Reinforcement learning (RL) has shown promising performance in autonomous driving, yet ensuring the safety of online RL policies remains challenging due to insufficient exposure to safety-critical driving scenes.

By Xincong Hu (Nanjing University), Lei Ou (Nanjing University), Maosen Li (Yinwang Intelligent Technology Co., Ltd), Jingtao Zhang (Yinwang Intelligent Technology Co., Ltd), Liguo Hou (Yinwang Intelligent Technology Co., Ltd), Zongzhang Zhang (Nanjing University)
arXiv Machine Learning
Sep 18

MILER: Semantic Mid-Level Representation for Sim-to-Real Reinforcement Learning in Unstructured Autonomous Driving

MILER is an end‑to‑end reinforcement learning framework that achieves zero‑shot sim‑to‑real transfer for autonomous driving in unstructured environments. It uses a custom semantic mid‑level representation (MLR) simulator for offline training, and during deployment it processes real camera and LiDAR data with BEVFusion to produce a compatible bird’s‑eye‑view representation. The policy’s actions are applied via a trajectory‑alignment strategy, allowing the system to drive 17.3 km on a 3.0 km test track without human intervention, all running on a Jetson AGX Orin.

By Thomas Steinecker, Denis Trescher, Alexander Bienemann, Thorsten Luettel, Mirko Maehlisch
arXiv Machine Learning
Jun 16

CoIRL-AD: Collaborative-Competitive Imitation-Reinforcement Learning in Latent World Models for Autonomous Driving

arXiv:2510. 12560v2 Announce Type: replace-cross Abstract: End-to-end autonomous driving models trained with imitation learning (IL) often generalize poorly, particularly in long-tail scenarios where expert demonstrations are sparse.

By Xiaoji Zheng, Ziyuan Yang, Yanhao Chen, Yuhang Peng, Yuanrong Tang, Gengyuan Liu, Bokui Chen, Jiangtao Gong
arXiv AI
Sep 17

Imitation Learning for Autonomous Driving in CARLA

The paper presents a compact multimodal policy trained via behavioral cloning to drive autonomously in the CARLA simulator. Using five‑frame histories of RGB images, LiDAR, telemetry, and lane waypoints, the 1.36‑million‑parameter model predicts throttle, brake, and steering at 20 Hz. Trained on 236,882 windows (≈3.3 hours of driving) from 448 captures, the policy drives for hours on both training and unseen routes without collisions, demonstrating qualitative transfer and recovery from large trajectory deviations.

By Jordy Kieto
arXiv AI
Sep 4

A Low-Cost, Open Platform for End-to-End Autonomous Driving on a Miniature Ackermann Vehicle

The paper introduces a low‑cost, open experimental platform for end‑to‑end autonomous driving on miniature Ackermann vehicles, combining a physical car, printed track, data collection tools, trajectory registration, and a Webots digital twin. It implements command‑conditioned behavior cloning, achieving a mean cross‑track error of 6.1 cm on the real vehicle and demonstrating the impact of camera field of view in simulation. Using synthetic data from the digital twin and a sim‑to‑real image translator, a higher‑capacity policy trained on both synthetic and real data completes all four track routes, outperforming the baseline trained only on real data.

By Gustavo Claudio Karl Couto, Eric Aislan Antonelo, Gabriel George Zipperer
arXiv Computer Vision
Sep 30

RoXDrive: Closed-Loop Reinforcement Learning for End-to-End Autonomous Driving via Action-Faithful Rollouts

arXiv:2609.36851v1 Announce Type: new Abstract: End-to-end autonomous driving policies are commonly trained via imitation learning on logged demonstrations without observing the consequences of their...

By Hongbin Lin, Chaoda Zheng, Yiming Yang, Xiangyu Li, Shijia Chen, Jinhao Deng, Kangjie Chen, Dongbin Zhang, Jie Feng, Yu Zhang, Xianming Liu, Shuguang Cui, Boyang Wang, Zhen Li
arXiv AI
Jul 1

What Probing Reveals about Autonomous Driving: Linking Internal Prediction Errors to Ego Planning

arXiv:2606. 31106v1 Announce Type: cross Abstract: Large-scale datasets and fast simulators have enabled improvements in driving policies that appear safe and robust, yet strong performance in nominal scenarios can still mask flawed reasoning and unsafe heuristics.

By Hyeonchang Jeon, Kyungbeom Kim, Eugene Vinitsky, Kyung-Joong Kim