arXiv AI
Aug 3
PAIR: Prefix-Aware Internal Reward Model for Multi-Turn Agent Optimization
arXiv:2605. 17877v2 Announce Type: replace Abstract: A significant hurdle for current LLMs is the execution of complex, multi-stage tasks.
Agent-G$^2$: Gaussian Guidance for Agentic Reinforcement Learning
Related stories
arXiv AI
Aug 25
EDGE: Experience-Distillation for Guided Exploration in Agentic Reinforcement Learning
arXiv:2608.21946v1 Announce Type: cross Abstract: Reinforcement learning with outcome-based objectives such as GRPO enables LLM-based agents to solve complex, long-horizon tasks, yet the reusable exp...
arXiv AI
Jul 24
PATS: Policy-Aware Training Scaffolding for Agentic Reinforcement Learning
arXiv:2607. 21419v1 Announce Type: new Abstract: In long-horizon LLM agent reinforcement learning, weak policies often repeat similar failures, producing uninformative rollout trajectories and limiting effective policy optimization.
arXiv AI
Jun 10
3SPO: State-Score-Supervised Policy Optimization for LLM Agents
arXiv:2606. 09961v1 Announce Type: cross Abstract: Training large language models (LLMs) as autonomous agents via reinforcement learning (RL) has enabled frontier models to achieve superhuman performance in long-horizon tasks.
arXiv AI
Jul 20
Process Reward Informed Tree Rollout for Effective Multi-Turn RL
arXiv:2607. 15610v1 Announce Type: cross Abstract: Reinforcement learning (RL) has become a key approach for training LLM agents, yet popular methods such as GRPO/RLOO rely on multiple independently sampled complete trajectories for advantage estimation.
arXiv Machine Learning
Jul 31
TAPO: Transition-Aware Policy Optimization for LLM Agents
arXiv:2607. 27973v1 Announce Type: new Abstract: Recently, Reinforcement Learning (RL) has emerged as a crucial paradigm for the post-training of Large Language Model (LLM) agents.
Hugging Face Trending Papers
Sep 2
PGPO: Potential-Guided Policy Optimization for Multi-Turn Agentic Tasks
PGPO: Potential-Guided Policy Optimization for Multi-Turn Agentic Tasks proposes a new reinforcement learning approach that estimates empirical state potentials from anchor-state-group return statistics within each rollout group. By deriving action advantages from potential differences between adjacent states, PGPO enables cross‑trajectory credit propagation, providing finer‑grained step‑level credit assignment, especially within failed trajectories. Experiments on ALFWorld and WebShop demonstrate strong overall performance compared to recent group‑based RL methods, with negligible training overhead.
arXiv Machine Learning
Jun 17
EnvRL: Learn from Environment Dynamics in Agentic Reinforcement Learning
arXiv:2606. 17680v1 Announce Type: new Abstract: Reinforcement learning (RL) has emerged as a powerful paradigm for training Large Language Models (LLMs) as agents.
arXiv AI
Sep 3
PGPO: Potential-Guided Policy Optimization for Multi-Turn Agentic Tasks
The paper introduces Potential-Guided Policy Optimization (PGPO), a method for multi-turn agentic tasks that improves credit assignment by estimating empirical state potentials from anchor-state-group return statistics. PGPO derives action advantages from potential differences between adjacent states, enabling cross-trajectory credit propagation and finer-grained step-level credit assignment, especially within failed trajectories. Experiments on ALFWorld and WebShop demonstrate strong performance compared to recent group-based reinforcement learning methods, with negligible training overhead.
arXiv AI
Jun 3
Local Guidance, Global Impact: Gaussian-Reshaped Trust Region Unlocks Behavior Transitions
arXiv:2606. 03382v1 Announce Type: cross Abstract: While Proximal Policy Optimization (PPO) demonstrates strong performance in stationary settings, we show that its standard optimization paradigm struggles in continual and non-stationary environments.
arXiv Machine Learning
Aug 10
Trajectory-Relative Hindsight Distillation for Agentic Reinforcement Learning
arXiv:2608. 07371v1 Announce Type: new Abstract: Recent agentic reinforcement learning methods use hindsight to complement sparse outcome rewards.
arXiv Machine Learning
Jul 7
CompactionRL: Reinforcement Learning with Context Compaction for Long-Horizon Agents
arXiv:2607. 05378v1 Announce Type: new Abstract: Long-horizon agentic LLMs are increasingly limited by finite context windows, as extended interaction trajectories can exceed the maximum context length before a task is completed.