arXiv:2604. 17456v2 Announce Type: replace Abstract: Large language model (LLM) agents have shown strong capabilities in long-horizon reasoning, tool use, and decision-making in digital environments, yet extending them to physically grounded systems remains challenging.
arXiv:2609.36934v1 Announce Type: new Abstract: Traffic signal control (TSC) is essential for improving urban mobility and reducing congestion. Although roadside cameras are widely deployed at signal...
arXiv:2608. 20129v1 Announce Type: cross Abstract: Autonomous vehicles require robust perception and decision-making capabilities to operate in diverse and unseen scenarios.
SimSkill is a lifelong learning AI agent that uses the SUMO traffic simulator to autonomously identify gaps in its capabilities, generate and solve tasks grounded in the environment, and verify solutions through an action‑critic loop. It consolidates experience into episodic, procedural, and semantic memory without updating its backbone language model, creating a reusable library for traffic‑simulation workflows. Evaluations on two benchmarks with three different LLM backbones show that SimSkill can improve verified completion rates by up to 25 percentage points, with procedural and semantic memory contributing complementarily to performance.
SimSkill is a self‑evolving large‑language‑model agent designed for the SUMO traffic simulator. It continuously detects capability gaps, creates and solves environment‑grounded tasks, verifies solutions via an action–critic loop, and stores experiences in episodic, procedural, and semantic memory. Evaluations on two held‑out benchmarks across three LLM backbones show up to a 25‑percentage‑point improvement in verified success, with procedural and semantic memory contributing complementarily.
arXiv:2505. 18334v2 Announce Type: replace-cross Abstract: Past work has demonstrated that autonomous vehicles can drive more safely if they communicate with each other.
arXiv:2607. 01639v1 Announce Type: new Abstract: Universal traffic laws describe recurrent patterns in congestion, mobility and driving behavior across cities, providing a scientific basis for transportation planning, management and control.
arXiv:2609.35916v1 Announce Type: cross Abstract: Real-world embodied agents often pursue independent objectives within a shared physical environment, where their actions can alter the conditions fac...
arXiv:2609.09578v1 Announce Type: cross Abstract: Urban planning is a real-world spatial optimization problem that requires selecting feasible actions from large candidate spaces under practical obje...
RideSkill is a hierarchical algorithm for generalized ride sharing that uses large language models (LLMs) to automatically design and train a skill repository, a combiner, and a repositioner. The combiner assigns vehicle-specific skills for adaptive dispatch across varying scenarios and objectives, while the repositioner moves idle vehicles to emerging regions to avoid conflicts. By training all components via an LLM-based evolutionary method, RideSkill eliminates the need for real-time LLM calls, enabling high-performance deployment in large-scale systems.
arXiv:2609.21945v1 Announce Type: new Abstract: Urban transportation networks present complex optimization challenges spanning calibration of high-fidelity simulators and real-time operational contro...
The paper proposes a new architecture for large language model (LLM) agents that enhances spatial understanding by combining geometrical tools with an LLM orchestrator in grid‑world environments. It first gathers geodesic trajectories, vector‑quantizes them to create a representative subset, and then has the LLM label each trajectory with a natural language description, turning them into reusable tools. During operation, the LLM selects the appropriate tool based on the current state and goal, while low‑level control executes the chosen trajectory, enabling efficient decision‑making in a partially observable 2D grid setting.
The paper introduces Composite‑Gradient Learning (CGL), a method that explicitly incorporates a model predictive controller (MPC) into the training of a deep reinforcement learning (DRL) agent by treating their control inputs as a joint action. CGL updates the DRL policy while accounting for the interaction with the MPC, unlike prior approaches that view MPC merely as part of the environment. Experiments on two freeway traffic networks show that CGL performs better than alternative methods when the interaction between DRL and MPC is strong, though overall gains are modest.