arXiv:2610.20293v1 Announce Type: cross Abstract: Large language models increasingly generate multiple retrieval actions jointly, while downstream systems often provide only one reward for the result...
The paper introduces ProAS, a Progress‑Aware Advantage Shaping framework designed to improve critic‑free reinforcement learning for large language model agents. ProAS uses a dynamic Agentic Reference Graph to provide fine‑grained credit assignment through Masking Unreasonable Incentives and Asymmetric Penalty Redistribution, avoiding the uniform advantage broadcast that can reinforce invalid actions. Experiments on Qwen2.5‑1.5B‑Instruct and Qwen2.5‑7B‑Instruct show that ProAS raises baseline success rates to 91.9% and 94.3% on ALFWorld and 66.7% and 70.8% on WebShop, while speeding up training convergence up to 2.44× and remaining robust to imperfect reference graphs.
Reinforcement learning (RL) has emerged as the primary paradigm for optimizing Large Language Model (LLM) agents, yet efficient critic-free algorithms (e.g., GRPO) suffer from a fundamental uniform cr...
arXiv:2609.36178v1 Announce Type: cross Abstract: Group Relative Policy Optimization (GRPO) has become a promising approach for training large language model agents. However, its uniform assignment o...
arXiv:2602. 08335v2 Announce Type: replace Abstract: Integrating Large Language Models (LLMs) with external tools via multi-agent systems offers a promising new paradigm for decomposing and solving complex problems.
arXiv:2610.28409v1 Announce Type: cross Abstract: Large language model agents are often given an inference budget and asked to maximise success within it. A multi-turn agent has to allocate this budg...
arXiv:2604.22785v2 Announce Type: replace Abstract: We develop a unified treatment of credit assignment for RL training in multi-agent LLM systems. We show that observed reward alone cannot distingui...
arXiv:2607. 03702v1 Announce Type: new Abstract: Large language model (LLM) agents have shown strong decision-making capabilities in long-horizon interactive tasks, yet they still struggle to effectively leverage failed trajectories: full retries incur high interaction costs, while experience retrieval tends to dilute critical experience signals.
arXiv:2609.15309v1 Announce Type: new Abstract: Large language model (LLM) agents allocate test-time compute adaptively as they revise solutions, use tools, explore alternatives, and decide when to s...
arXiv:2610.08402v1 Announce Type: new Abstract: Multi-turn LLM agents often receive sparse task feedback across several interactions, while generating each response token by token. This creates two r...
arXiv:2610.17893v1 Announce Type: new Abstract: Effective collaboration among large language model (LLM) agents in multi-agent systems requires sharing relevant evidence, requesting missing informati...
arXiv:2511. 10687v3 Announce Type: replace-cross Abstract: Large Language Models (LLMs) in multi-agent systems (MAS) have shown promise for complex tasks, yet current training methods lack principled ways to connect system-level evaluation with agent- and message-level learning.