arXiv AI

SHRED: Self-Play for Heterogeneous Road-Users without Expert Demonstrations

SHRED is a framework that trains vehicles, pedestrians, and cyclists through large‑scale heterogeneous self‑play from random initialization, without using expert demonstrations or logged trajectories. By combining type‑specific dynamics, procedural scenario generation, and per‑agent randomization, SHRED allows diverse, realistic behaviors to emerge through closed‑loop interaction. In benchmarks such as the Waymo Open Sim Agents Challenge and InterPlan, SHRED outperforms demonstration‑free baselines and prior self‑play methods, showing that heterogeneity in self‑play improves both traffic realism and planning performance.

arXiv AI
Jul 15

TerraZero: Procedural Driving Simulation for Zero-Demonstration Self-Play at Scale

arXiv:2607. 13028v1 Announce Type: cross Abstract: Training robust autonomous driving agents requires a simulator that is fast enough for reinforcement learning at scale, realistic enough to ground behavior in real-world map structure, and diverse enough to cover the safety-critical long tail that logged data rarely contains.

By Zhouchonghao Wu, Akshay Rangesh, Weixin Li, Wei-Jer Chang, Zachary Lee, Tim Wang, Wei Zhan
arXiv Computer Vision
Aug 25

BehaviorWorldGen: Closing the Loop between Action Models and World Simulators via Controllable Behavior-Aware Structured World Generation

arXiv:2608.22187v1 Announce Type: cross Abstract: Modern driving action models are increasingly improved in a self-improvement loop, where a learned world simulator imagines future observations and t...

By Jiaqi Wang, Zhuo Zhang, Haining Guan, Tingguang Zhou, Haowen Cui, Zhongyang Zhu, Yulong Zheng, ChuanYe Wang, Xuefeng Chen, Zhen Yang, Tianchen Deng, Feiyang Tan, Hangning Zhou, Bo Dai, Lixia Shen, Xiwu Chen, Xiyang Wang, Jiajun Zhu
arXiv Computer Vision
Oct 8

Controllable Crowd Generation through World-Model Planning

The paper introduces Ctrl-CWM, a multi‑agent controllable crowd world model that merges crowd generation with run‑time control. It uses an encoder to learn human motion dynamics, an actor to propose pedestrian displacements, a critic to evaluate imagined trajectories, and a planner that selects actions based on critic scores and user‑defined costs. Experiments show that Ctrl‑CWM outperforms state‑of‑the‑art methods in realism and collision metrics while allowing new control objectives to be added without retraining.

By JunGyu Lee, Jisu Shin, Seunghyun Shin, Hae-Gon Jeon
arXiv AI
Jul 24

Compact Latent Coordination for Autonomous Vehicles at Unsignalized Intersections

arXiv:2607. 21488v1 Announce Type: cross Abstract: Coordinating autonomous vehicles at unsignalized intersections remains a critical challenge for multi-agent reinforcement learning (MARL) systems, which typically struggle with combinatorial action spaces, reliance on privileged information, or rigid agent designs.

By Gil Lifshits, Igal Bilik, Gilad Katz
arXiv AI
Jul 24

Drive As You Like: Multi-Head Diffusion with Reinforcement Learning for Personalized Driving

arXiv:2508. 16947v2 Announce Type: replace-cross Abstract: Despite significant progress, imitation learning-based autonomous driving planners remain largely restricted to reproducing high-frequency biased behaviors, overlooking the inherent behavioral diversity of human driving.

By Fan Ding, Xuewen Luo, Fucai Ke, Hwa Hui Tew, Susilawati Susilawati, Vishnu Monn Baskaran, Junn Yong Loo
Hugging Face Trending Papers
Jun 25

Proposal-Conditioned Latent Diffusion for Closed-Loop Traffic Scenario Generation

Closed-loop traffic simulation remains challenging because it must generate interactive multi-agent behaviors that are scene-consistent and controllable throughout rollout. Prior diffusion-based approaches achieve strong realism, but their computational cost can hinder deployment in time-constrained replanning loops for autonomous vehicle planning and simulation.