arXiv AI

Is Per-Agent Policy Composition Safe? Rethinking Successor-Feature Transfer in Cooperative Multi-Agent Reinforcement Learning

arXiv:2608. 11658v1 Announce Type: cross Abstract: Many reinforcement learning systems, from fleet management to traffic signal control, must serve an objective that changes dynamically after deployment, and retraining a policy for each new objective is prohibitively expensive.

arXiv Machine Learning
Jun 15

Contract-Based Compositional Shielding for Safe Multi-Agent Reinforcement Learning

arXiv:2606. 14130v1 Announce Type: new Abstract: Safe coordination problems surface in multi-agent reinforcement learning when global safety cannot be enforced by any agent unilaterally: the admissibility of one agent's action may depend on the dynamics of other agents.

By Omar Adalat, Edwin Hamel-De le Court, Francesco Belardinelli
arXiv Machine Learning
Sep 3

RideSkill: A Hierarchical Algorithm for Generalized Ride Sharing with LLM-Driven Automatic Evolution

RideSkill is a hierarchical algorithm for generalized ride sharing that uses large language models (LLMs) to automatically design and train a skill repository, a combiner, and a repositioner. The combiner assigns vehicle-specific skills for adaptive dispatch across varying scenarios and objectives, while the repositioner moves idle vehicles to emerging regions to avoid conflicts. By training all components via an LLM-based evolutionary method, RideSkill eliminates the need for real-time LLM calls, enabling high-performance deployment in large-scale systems.

By Zijian Zhao, Sen Li, Xialiang Tong, Mingxuan Yuan
arXiv AI
Jun 2

Coordination Graphs for Constrained Multi-Agent Reinforcement Learning

arXiv:2606. 02337v1 Announce Type: new Abstract: Constrained Multi-agent reinforcement learning (CMARL) faces two intertwined challenges: the joint action space grows exponentially with the number of agents, and additional requirements couple agents in ways that reward structure alone does not capture.

By Santiago Amaya-Corredor, Miguel Calvo-Fullana, Anders Jonsson
arXiv AI
Jun 2

When Does Multi-Agent RL Improve LLM Workflows? Workflow, Scale, and Policy-Sharing Tradeoffs

arXiv:2605. 24202v2 Announce Type: replace Abstract: Multi-agent LLM workflows route inference through specialized roles to lift end-task accuracy, but jointly training those roles with reinforcement learning is unstable in ways that are poorly understood.

By Yifan Zeng, Yiran Wu, Yaolun Zhang, Wentian Zhao, Kun Wan, Qingyun Wu, Huazheng Wang
arXiv AI
Sep 2

Explore More, Drift Less: Outcome-Only Reinforcement Learning Can Suffice for Long-Horizon Interactive Agents

The paper proposes CANOPY, a minimalist reinforcement learning protocol that addresses two common pitfalls—signal starvation and policy drift—in outcome‑only RL for long‑horizon interactive tasks. By scaling same‑task exploration, keeping updates on‑policy, and anchoring updates with KL divergence, CANOPY enables a Qwen3‑14B agent to achieve top leaderboard results on the AppWorld coding benchmark without auxiliary supervision or elaborate scaffolding. The approach also improves performance on SWE‑bench for a Qwen3.5‑9B model.

By Liming Pu, Xiaoxia Li, Yifu Liu, Teng Cao, Bin Yang