The paper presents a modeling and simulation framework to study reinforcement learning (RL) control of connected and automated vehicle (CAV) platoon joining maneuvers in mixed traffic. Using SUMO and agent-based modeling, it evaluates Deep Q-Network (DQN), Double DQN (DDQN), and Proximal Policy Optimization (PPO) algorithms, finding that PPO achieves a 98 % joining success rate with less than 1 % collision rate by incorporating risk penalties. The study also shows a trade‑off between safety, joining effectiveness, and decision efficiency, and demonstrates that an external safety controller can prevent collisions but may reduce joining efficiency.
By Biao Yin, Abderrahmane Kasmi, Nadir Farhi
The paper presents a modeling and simulation framework to study reinforcement‑learning control of connected and automated vehicle (CAV) platoon joining maneuvers in mixed traffic. It evaluates Deep Q‑Network, Double Deep Q‑Network, and Proximal Policy Optimization algorithms, finding that PPO achieves a 98 % joining success rate with less than 1 % collisions by incorporating risk penalties, though it requires more decision steps. An external safety controller can prevent collisions but may reduce joining efficiency, highlighting a trade‑off between safety, effectiveness, and decision speed.
The paper introduces Composite‑Gradient Learning (CGL), a method that explicitly incorporates a model predictive controller (MPC) into the training of a deep reinforcement learning (DRL) agent by treating their control inputs as a joint action. CGL updates the DRL policy while accounting for the interaction with the MPC, unlike prior approaches that view MPC merely as part of the environment. Experiments on two freeway traffic networks show that CGL performs better than alternative methods when the interaction between DRL and MPC is strong, though overall gains are modest.
By Giray \"On\"ur, Azita Dabiri, Bart De Schutter
arXiv:2609.36934v1 Announce Type: new
Abstract: Traffic signal control (TSC) is essential for improving urban mobility and reducing congestion. Although roadside cameras are widely deployed at signal...
By Pan Zhang, Siqi Lai, Kemu Dong, Hao Liu
arXiv:2412.02520v4 Announce Type: replace-cross
Abstract: Connected automated vehicles (CAVs) equipped with adaptive cruise control (ACC) create new opportunities for highway congestion mitigation. T...
By Yaron Veksler, Sharon Hornstein, Han Wang, Maria Laura Delle Monache, Daniel Urieli
arXiv:2508. 00917v2 Announce Type: replace-cross Abstract: Connected autonomous vehicles (CAVs) must simultaneously perform multiple tasks, such as perception, prediction, planning, and control, to ensure safe and reliable navigation in complex environments.
By Jiayuan Wang, Farhad Pourpanah, Q. M. Jonathan Wu, Ning Zhang