← Back to all news
arXiv Machine Learning By Mahmoud Selim, Cristina Cipriani, Karl Henrik Johansson

Beyond Policy Support: Interaction Constrained Offline Reinforcement Learning for Autonomous Driving

Read the original on arXiv Machine Learning →

The paper introduces Interaction-Constrained Drive Policy (ICDP), an offline reinforcement learning framework for autonomous driving that explicitly controls interaction-level distribution shift. ICDP decomposes joint-support degradation into ego-support and interaction-support components, estimating the latter via contrastive density-ratio estimation without requiring joint-density modeling or simulator rollouts. Experiments on nuPlan, Interplan, and real-world truck data demonstrate that ICDP reduces selection of high-value but interaction-unsupported trajectories and improves performance in interaction-critical driving scenarios.

Machine-generated by The Flow from the publisher's headline and feed description — not written or checked by a human. The full article lives at arXiv Machine Learning.

Related stories

arXiv Machine Learning
Jul 22

End-to-end Conditional Diffusion for Realistic and Controllable Visual Traffic Scenario Generation

arXiv:2607. 18637v1 Announce Type: cross Abstract: Generating closed-loop traffic scenarios that are both realistic and controllable is crucial for evaluating autonomous driving systems, especially under rare safety-critical interactions.

By Jingzheng Li, Yufei Ge, Zhijun Chen, Qianren Mao, Zizhe Wang, Binhang Qi, Bing Li, Keyu Chen, Baochang Zhang, Xianglong Liu, Philip S Yu
agentsdiffusionroboticssafety
More like this →
arXiv Computer Vision
Sep 30

RoXDrive: Closed-Loop Reinforcement Learning for End-to-End Autonomous Driving via Action-Faithful Rollouts

arXiv:2609.36851v1 Announce Type: new Abstract: End-to-end autonomous driving policies are commonly trained via imitation learning on logged demonstrations without observing the consequences of their...

By Hongbin Lin, Chaoda Zheng, Yiming Yang, Xiangyu Li, Shijia Chen, Jinhao Deng, Kangjie Chen, Dongbin Zhang, Jie Feng, Yu Zhang, Xianming Liu, Shuguang Cui, Boyang Wang, Zhen Li
agentsreinforcement-learningroboticssafety
More like this →
arXiv AI
Aug 12

Threat-guided Policy-aware Scene Perturbation for Safe Autonomous Driving with Online Reinforcement Learning

arXiv:2608. 10403v1 Announce Type: new Abstract: Reinforcement learning (RL) has shown promising performance in autonomous driving, yet ensuring the safety of online RL policies remains challenging due to insufficient exposure to safety-critical driving scenes.

By Xincong Hu (Nanjing University), Lei Ou (Nanjing University), Maosen Li (Yinwang Intelligent Technology Co., Ltd), Jingtao Zhang (Yinwang Intelligent Technology Co., Ltd), Liguo Hou (Yinwang Intelligent Technology Co., Ltd), Zongzhang Zhang (Nanjing University)
agentsreinforcement-learningroboticsbenchmarkssafety
More like this →
arXiv AI
Jul 1

What Probing Reveals about Autonomous Driving: Linking Internal Prediction Errors to Ego Planning

arXiv:2606. 31106v1 Announce Type: cross Abstract: Large-scale datasets and fast simulators have enabled improvements in driving policies that appear safe and robust, yet strong performance in nominal scenarios can still mask flawed reasoning and unsafe heuristics.

By Hyeonchang Jeon, Kyungbeom Kim, Eugene Vinitsky, Kyung-Joong Kim
agentsreinforcement-learningrobotics
More like this →
arXiv Machine Learning
Jun 16

CoIRL-AD: Collaborative-Competitive Imitation-Reinforcement Learning in Latent World Models for Autonomous Driving

arXiv:2510. 12560v2 Announce Type: replace-cross Abstract: End-to-end autonomous driving models trained with imitation learning (IL) often generalize poorly, particularly in long-tail scenarios where expert demonstrations are sparse.

By Xiaoji Zheng, Ziyuan Yang, Yanhao Chen, Yuhang Peng, Yuanrong Tang, Gengyuan Liu, Bokui Chen, Jiangtao Gong
agentsreinforcement-learningroboticsbenchmarks
More like this →