arXiv Machine Learning By Ferdous Al Rafi, Susrik Mukherjee, Latika Liladhar Dekate, Jennifer Yawa Lavoe, Huaiyuan Yao, Shlok Mohanty, Longchao Da, Xuesong Zhou, Hua Wei

Sim2Signal: Sim-to-Real Benchmarks for Traffic Signal Control

Read the original on arXiv Machine Learning →

Sim2Signal is a benchmark designed to systematically measure the Sim-to-Real gap in traffic signal control by decomposing it into observation, action, transition, and reward gaps. The study evaluates 18 mitigation methods across 33 gap settings and 10 calibrated networks from five real-world locations, finding that direct transfer degrades performance but mitigation effectiveness varies by network and gap type. The most effective approaches tend to estimate the specific changes caused by each gap rather than relying on domain randomization or invariant representations.

Machine-generated by The Flow from the publisher's headline and feed description — not written or checked by a human. The full article lives at arXiv Machine Learning.

arXiv Machine Learning
Oct 8

EvoSignal: LLM-Guided Evolutionary Design of Modular Traffic Signal Control Programs

EvoSignal is an LLM‑guided evolutionary framework that treats traffic signal control as a modular program design problem, separating traffic feature extraction, local phase prioritization, and optional network‑based priority adjustment. Starting from established strategies, it iteratively improves programs using congestion and signal operation feedback, ultimately producing control rules that operate without online LLM inference. In simulations on two real‑world road networks, the best EvoSignal program reduced waiting time by 16.8–49.2% compared to 20 conventional, reinforcement‑learning, and LLM‑based baselines, and a travel‑time/queue‑length prioritizing program consistently outperformed all baselines across multiple scenarios.

By Leizhen Wang, Peibo Duan, Zhenlin Qin, Yancheng Ling, Jian Xu, Yue Wang, Hao Wang, Zhenliang Ma
arXiv Machine Learning
Oct 3

Crossing the Cyber Divide: Sim-to-Sim and Sim-to-Real Transfer for RL Agents

The paper investigates how reinforcement learning agents trained in one cyber simulation can be transferred to other simulators or real environments. It introduces a framework that decouples state alignment from action translation, allowing zero‑shot policy transfer without retraining. Experiments across four cyber platforms show that transferred policies can preserve performance in closely aligned settings and achieve substantial win rates in more divergent environments.

By Sabrina Saika, Yinuo Du, Aritran Piplai