arXiv AI

Explainable Reinforcement Learning for Adaptive Traffic Signal Control

arXiv:2607. 03703v1 Announce Type: new Abstract: Reinforcement Learning (RL) has emerged as a powerful paradigm for adaptive traffic signal control.

arXiv AI
Jun 29

OverFlowLight: Real-Time Gridlock Prevention and Traffic Signal Optimization for Urban Intersections

arXiv:2606. 27381v1 Announce Type: cross Abstract: Queue overflow, a severe consequence of urban traffic congestion, occurs when vehicle queues exceed intersection capacity, obstructing upstream traffic and triggering cascading gridlocks.

By Mingyuan Li, Boyang Huang, Tianqi Jiang, Chenpu Li, Chunyu Liu, Yang Li, Ruimin Li, Qiang Wu
arXiv Machine Learning
Aug 20

SIGMA: Symmetry-aware, Intelligent, Geometric, Multi-objective Adaptive Control for Robust, Dependable Traffic Management

SIGMA is a reinforcement‑learning framework for traffic signal control that incorporates a large language model to adaptively tune multiple objectives based on natural‑language emergency commands. It uses rotational data augmentation to learn orientation‑invariant policies and an offline‑to‑online training pipeline to ensure stable deployment. Experiments in SUMO on four Kolkata intersections show that SIGMA reduces waiting times, queue lengths, and improves throughput compared to fixed‑time, actuated, and DQN baselines, with ablation studies confirming robustness to component failures and geometric rotations.

By Pratham Payra, Jagadish B, Tanmay Sen, Tanujit Chakraborty
arXiv Machine Learning
Aug 13

Language-Structured Relational Q-Learning for Threat-Aware Control in Safety-Critical Driving

arXiv:2608. 11498v1 Announce Type: cross Abstract: Natural-language-based scenario generation offers an intuitive means of describing rare and complex driving interactions, yet it is still uncertain whether training with language-structured data leads to truly adaptive control policies.

By Aditya Humnabadkar, Huaizhong Zhang, Ardhendu Behera
arXiv AI
Aug 28

Reinforcement Learning-Based Control of CAV Platoon Joining Maneuvers in Mixed Traffic

The paper presents a modeling and simulation framework to study reinforcement learning (RL) control of connected and automated vehicle (CAV) platoon joining maneuvers in mixed traffic. Using SUMO and agent-based modeling, it evaluates Deep Q-Network (DQN), Double DQN (DDQN), and Proximal Policy Optimization (PPO) algorithms, finding that PPO achieves a 98 % joining success rate with less than 1 % collision rate by incorporating risk penalties. The study also shows a trade‑off between safety, joining effectiveness, and decision efficiency, and demonstrates that an external safety controller can prevent collisions but may reduce joining efficiency.

By Biao Yin, Abderrahmane Kasmi, Nadir Farhi
Hugging Face Trending Papers
Aug 27

Reinforcement Learning-Based Control of CAV Platoon Joining Maneuvers in Mixed Traffic

The paper presents a modeling and simulation framework to study reinforcement‑learning control of connected and automated vehicle (CAV) platoon joining maneuvers in mixed traffic. It evaluates Deep Q‑Network, Double Deep Q‑Network, and Proximal Policy Optimization algorithms, finding that PPO achieves a 98 % joining success rate with less than 1 % collisions by incorporating risk penalties, though it requires more decision steps. An external safety controller can prevent collisions but may reduce joining efficiency, highlighting a trade‑off between safety, effectiveness, and decision speed.

arXiv Machine Learning
Aug 27

Spatio-temporal dual-stage hypergraph MARL for human-centric multimodal corridor traffic signal control

The paper introduces STDSH-MARL, a multi-agent deep reinforcement learning framework that uses a dual-stage hypergraph attention mechanism to capture spatio-temporal dependencies in corridor traffic signal control. It employs a hybrid discrete action space to jointly set signal phase configurations and green durations, allowing more adaptive timing. Experiments on a corridor network show that STDSH-MARL outperforms state‑of‑the‑art baselines, notably reducing tram waiting times while balancing overall network efficiency, tram priority, and bus service quality.

By Xiaocai Zhang, Neema Nassir, Milad Haghani
arXiv AI
Jun 2

TrafficClaw: A Generalizable LLM Agent in the Unified Physical Environment for Urban Traffic Control

arXiv:2604. 17456v2 Announce Type: replace Abstract: Large language model (LLM) agents have shown strong capabilities in long-horizon reasoning, tool use, and decision-making in digital environments, yet extending them to physically grounded systems remains challenging.

By Siqi Lai, Pan Zhang, Yuping Zhou, Jindong Han, Yansong Ning, Hao Liu
arXiv AI
Jul 3

DriveVLM-RL: Neuroscience-Inspired Reinforcement Learning with Vision-Language Models for Safe and Deployable Autonomous Driving

arXiv:2603. 18315v2 Announce Type: replace-cross Abstract: Traditional reinforcement learning (RL) methods rely on manually engineered rewards or sparse collision signals, which fail to capture the rich contextual understanding required for safe driving and make unsafe exploration unavoidable in real-world settings.

By Zilin Huang, Zihao Sheng, Zhengyang Wan, Yansong Qu, Junwei You, Sicong Jiang, Sikai Chen
arXiv Machine Learning
Sep 18

REARL: A Closed-loop Autonomous Driving Simulation Enhancement Framework with Real Traffic Data and Large Language Models

REARL is a closed‑loop simulation enhancement framework that combines real traffic data with large language models (LLMs) to improve autonomous driving simulations. It clusters real traffic, uses cluster centers as representative scenarios for the LLM, and employs a sliding‑window detector to monitor vehicle speed and spacing discrepancies. When thresholds are exceeded, the LLM adjusts vehicle decision‑making or selects matching real vehicle actions, resulting in lower Hellinger distance and MAPE compared to baselines in a HighD highway setting.

By Xiaojun Bi (Minzu University of China, Beijing, China), Jun Jiang (Minzu University of China, Beijing, China), Yiwen Sun (Peking University, Beijing, China, BIGAI, Beijing, China), Quanyi Ou (Minzu University of China, Beijing, China), Ke Cheng (Beihang University, Beijing, China), Mingjie Bi (BIGAI, Beijing, China), Yexin Li (BIGAI, Beijing, China)