arXiv AI September 28, 2026 By Xiangyuan Xue, Yifan Zhou, Zidong Wang, Shengji Tang, Philip Torr, Wanli Ouyang, Lei Bai, Zhenfei Yin

StraTA: Incentivizing Agentic Reinforcement Learning with Strategic Trajectory Abstraction

Read the original on arXiv AI →

StraTA introduces Strategic Trajectory Abstraction, a framework that samples a compact strategy from the initial task state and conditions subsequent actions on that strategy, training strategy generation and action execution jointly with a hierarchical GRPO-style rollout design. The method enhances exploration and credit assignment over long horizons by incorporating diverse strategy rollouts and critical self-judgment. Experiments on ALFWorld, WebShop, and SciWorld demonstrate that StraTA consistently improves sample efficiency and final performance, achieving success rates of 93.1% on ALFWorld, 84.2% on WebShop, and a 63.5% overall score on SciWorld, surpassing frontier closed‑source models.

Machine-generated by The Flow from the publisher's headline and feed description — not written or checked by a human. The full article lives at arXiv AI.

arXiv AI

Aug 19

PlanPO: Group Planning-Aware Policy Optimization for Multi-Turn Agentic LLMs

PlanPO introduces a group planning-aware policy optimization method for multi-turn agentic large language models, addressing the issue of advantage collapse caused by treating all successful trajectories equally. By incorporating coarse-to-fine advantage signals that reflect differences in trajectory and turn lengths, PlanPO encourages agents to learn generalizable planning and generation behaviors. Experiments show a 27.2% average improvement over GRPO on benchmarks such as ALFWorld, WebShop, and SciWorld, with minimal extra training cost.

By Dayang Liang, Liyuan He, Xuan Feng, Shuxin Li, Bo An, Yunlong Liu

llms agents reinforcement-learning benchmarks

Hugging Face Trending Papers

Aug 17

TRCA: Transition-wise Rubric Credit Assignment for Long-horizon LLM Agents

Long-horizon large language model (LLM) agents are typically optimized with sparse terminal outcomes, making fine-grained credit assignment across multi-step interactions difficult. Existing approache...

llms agents reinforcement-learning benchmarks

arXiv Machine Learning

Jun 17

EnvRL: Learn from Environment Dynamics in Agentic Reinforcement Learning

arXiv:2606. 17680v1 Announce Type: new Abstract: Reinforcement learning (RL) has emerged as a powerful paradigm for training Large Language Models (LLMs) as agents.

By Zhitong Wang, Songze Li, Hao Peng, Shuzheng Si, Yi Wang, Maosong Sun, Juanzi Li

llms agents reinforcement-learning benchmarks

arXiv AI

Aug 21

SAPO: Single-Rollout Autoregressive Policy Optimization for Agentic Reinforcement Learning

arXiv:2608. 19842v1 Announce Type: new Abstract: Agentic reinforcement learning (RL) has become a critical stage in the post-training of large language models.

By Dayang Liang, Lang Feng, Bo An, Yunlong Liu

llms agents reinforcement-learning

Hugging Face Trending Papers

Aug 20

SAPO: Single-Rollout Autoregressive Policy Optimization for Agentic Reinforcement Learning

Agentic reinforcement learning (RL) has become a critical stage in the post-training of large language models. Existing critic-free, group-relative methods estimate policy advantages from multiple rollouts, avoiding the substantial memory overhead of conventional proximal policy optimization (PPO) and achieving strong performance on long-horizon interactive tasks.

llms agents reinforcement-learning

arXiv AI

1d ago

T2SPO: Trajectory-to-Step Policy Optimization for Agentic Reinforcement Learning

arXiv:2610.00388v1 Announce Type: cross Abstract: Reinforcement learning enables large language model (LLM) agents to learn multi-step behaviors through interaction with their environments. However,...

By Bo-Wen Zhang, Junwei He, Maoqi Liu, Feiran Li, Song-Lin Lv, Wentao Ma, Rongyi Lin, Shuhan Zhong, Lan-Zhe Guo

llms agents reinforcement-learning

One email a morning, machine-written

Related stories

PlanPO: Group Planning-Aware Policy Optimization for Multi-Turn Agentic LLMs

TRCA: Transition-wise Rubric Credit Assignment for Long-horizon LLM Agents

EnvRL: Learn from Environment Dynamics in Agentic Reinforcement Learning

SAPO: Single-Rollout Autoregressive Policy Optimization for Agentic Reinforcement Learning

SAPO: Single-Rollout Autoregressive Policy Optimization for Agentic Reinforcement Learning

T2SPO: Trajectory-to-Step Policy Optimization for Agentic Reinforcement Learning