arXiv Machine Learning

RideSkill: A Hierarchical Algorithm for Generalized Ride Sharing with LLM-Driven Automatic Evolution

RideSkill is a hierarchical algorithm for generalized ride sharing that uses large language models (LLMs) to automatically design and train a skill repository, a combiner, and a repositioner. The combiner assigns vehicle-specific skills for adaptive dispatch across varying scenarios and objectives, while the repositioner moves idle vehicles to emerging regions to avoid conflicts. By training all components via an LLM-based evolutionary method, RideSkill eliminates the need for real-time LLM calls, enabling high-performance deployment in large-scale systems.

arXiv AI
Jul 7

Multi-Agent Reinforcement Learning for V2X Resource Allocation: Disentangling MARL Challenges Through Benchmarking

arXiv:2603. 06607v2 Announce Type: replace-cross Abstract: Radio resource allocation (RRA) is a critical function in cellular vehicle-to-everything (C-V2X) networks, where vehicles must share limited wireless resources to support safety-critical communications.

By Siyuan Wang, Lei Lei, Pranav Maheshwari, Sam Bellefeuille, Kan Zheng
arXiv AI
Jun 2

TrafficClaw: A Generalizable LLM Agent in the Unified Physical Environment for Urban Traffic Control

arXiv:2604. 17456v2 Announce Type: replace Abstract: Large language model (LLM) agents have shown strong capabilities in long-horizon reasoning, tool use, and decision-making in digital environments, yet extending them to physically grounded systems remains challenging.

By Siqi Lai, Pan Zhang, Yuping Zhou, Jindong Han, Yansong Ning, Hao Liu
arXiv AI
Jul 15

DeepTravel: An End-to-End Agentic Reinforcement Learning Framework for Autonomous Travel Planning Agents

arXiv:2509. 21842v2 Announce Type: replace Abstract: Travel planning (TP) agent has recently worked as an emerging building block to interact with external tools/resources for travel itinerary generation, ensuring an enjoyable user experience.

By Yansong Ning, Rui Liu, Jun Wang, Kai Chen, Wei Li, Jun Fang, Kan Zheng, Naiqiang Tan, Hao Liu
arXiv AI
Sep 2

Reinforcement Learning Enhanced LLM Agents for Complex Vehicle Routing Problems

The paper introduces Reinforcement Learning Enhanced LLM Agents (RLEA), a multi‑agent framework that automates the modeling of complex Vehicle Routing Problems (VRPs). RLEA employs a lightweight neural Planner trained with Soft Q‑learning to coordinate LLM‑based agents, and incorporates an evolutionary memory module and retrieval‑augmented generation to leverage experience and external solver knowledge. Experiments on 48 VRP variants show that RLEA outperforms the prior state‑of‑the‑art method, achieving a 16.67% higher success rate and significantly reducing runtime errors.

By Yi Chen, Zikang Yu, Jiahai Wang, Jinbiao Chen, Jianpeng Zhou, Zizhen Zhang
arXiv AI
Oct 5

LLM-Guided Reinforcement Learning with Representative Agents for Traffic Modeling

The paper proposes a scalable traffic modeling approach that uses a single representative large language model (LLM) agent for each homogeneous traveler group, rather than one LLM per traveler. The representative agent maintains a mixed strategy over routes, updates it daily based on positive reinforcement signals, and uses a tunable step size to adjust its strategy. This design improves scalability, stabilizes learning, and produces interpretable dynamics that reproduce realistic behavioral patterns such as the decoy effect and income‑based willingness‑to‑pay differences.

By Hanlin Sun, Jiayang Li
arXiv AI
Sep 4

SimSkill: A Lifelong Learning AI Agent for Autonomous Mastery of Traffic Simulation

SimSkill is a lifelong learning AI agent that uses the SUMO traffic simulator to autonomously identify gaps in its capabilities, generate and solve tasks grounded in the environment, and verify solutions through an action‑critic loop. It consolidates experience into episodic, procedural, and semantic memory without updating its backbone language model, creating a reusable library for traffic‑simulation workflows. Evaluations on two benchmarks with three different LLM backbones show that SimSkill can improve verified completion rates by up to 25 percentage points, with procedural and semantic memory contributing complementarily to performance.

By Qi Liu, Qinzheng Wang, Yiming Bie
arXiv AI
Jun 19

Oranits: Mission Assignment and Task Offloading in Open RAN-based ITS using Metaheuristic and Deep Reinforcement Learning

arXiv:2507. 19712v3 Announce Type: replace-cross Abstract: In this paper, we explore mission assignment and task offloading in an Open Radio Access Network (Open RAN)-based intelligent transportation system (ITS), where autonomous vehicles leverage mobile edge computing for efficient processing.

By Ngoc Hung Nguyen, Nguyen Van Thieu, Quang-Trung Luu, Anh Tuan Nguyen, Senura Wanasekara, Nguyen Cong Luong, Fatemeh Kavehmadavani, Van-Dinh Nguyen
arXiv AI
Oct 12

Collective Autonomous Vehicle Routing Needs Social Awareness for Coexistence with Human Drivers

The paper proposes adding a social component—marginal cost—to autonomous vehicle (AV) routing rewards to account for the impact of AVs on human-driven vehicles (HDVs). Using multi-agent reinforcement learning on real-world networks, the authors show that this social reward reduces HDV travel time increases and improves overall system performance compared to purely selfish AV routing. A scalable approach limits counterfactual simulations to the most influential AVs, maintaining performance while cutting computational cost.

By Anastasia Psarou, Mikolaj Rams, Blazej Torbus, Rafal Kucharski
arXiv AI
Sep 12

SimSkill: A Self-Evolving LLM Agent for Skill and Knowledge Accumulation in Traffic Simulation

SimSkill is a self‑evolving large‑language‑model agent designed for the SUMO traffic simulator. It continuously detects capability gaps, creates and solves environment‑grounded tasks, verifies solutions via an action–critic loop, and stores experiences in episodic, procedural, and semantic memory. Evaluations on two held‑out benchmarks across three LLM backbones show up to a 25‑percentage‑point improvement in verified success, with procedural and semantic memory contributing complementarily.

By Qi Liu, Qinzheng Wang, Can Li, Yiming Bie, Wanjng Ma