The Flow has not summarised this story yet — read it at Hugging Face Trending Papers.
The paper introduces ProAS, a Progress‑Aware Advantage Shaping framework designed to improve critic‑free reinforcement learning for large language model agents. ProAS uses a dynamic Agentic Reference Graph to provide fine‑grained credit assignment through Masking Unreasonable Incentives and Asymmetric Penalty Redistribution, avoiding the uniform advantage broadcast that can reinforce invalid actions. Experiments on Qwen2.5‑1.5B‑Instruct and Qwen2.5‑7B‑Instruct show that ProAS raises baseline success rates to 91.9% and 94.3% on ALFWorld and 66.7% and 70.8% on WebShop, while speeding up training convergence up to 2.44× and remaining robust to imperfect reference graphs.
arXiv:2609.36178v1 Announce Type: cross Abstract: Group Relative Policy Optimization (GRPO) has become a promising approach for training large language model agents. However, its uniform assignment o...
Large Language Model (LLM) agents increasingly solve long-horizon tasks through multi-turn interactions with users and external tools. In these settings, relevant task information often unfolds over t...
The paper introduces Influence-Aware Policy Optimization (IAPO), a method that models multi‑turn agent rollouts as typed influence‑dependency graphs to better assign credit to actions based on how information and errors flow through user and tool interactions. IAPO transforms the structure of support and failure usage into routing weights that redistribute trajectory‑level advantage, enabling more effective learning from sparse final rewards. Experiments with Qwen3‑4B and Qwen3‑8B on three service‑agent benchmarks show that IAPO outperforms existing multi‑turn reinforcement learning baselines without harming function‑calling performance.
arXiv:2606.22995v2 Announce Type: replace-cross Abstract: Group-based Reinforcement Learning (RL) has significantly enhanced Large Language Models (LLMs) in agentic scenarios. To achieve finer-graine...
arXiv:2606. 20008v1 Announce Type: new Abstract: Reinforcement learning with verifiable rewards has become a central tool for improving the reasoning ability of large language models, but current methods face a trade-off between simplicity and credit assignment.