← Back to all news
arXiv Machine Learning By Peng Xia, Jianwen Chen, Hanyang Wang, Jiaqi Liu, Kaide Zeng, Yu Wang, Siwei Han, Yiyang Zhou, Xujiang Zhao, Haifeng Chen, Zeyu Zheng, Cihang Xie, Huaxiu Yao

SkillRL: Evolving Agents via Recursive Skill-Augmented Reinforcement Learning

Read the original on arXiv Machine Learning →

SkillRL is a framework that enhances large language model agents by automatically discovering and evolving skills from raw experience. It builds a hierarchical skill library called SkillBank, uses an adaptive retrieval strategy for heuristics, and allows the skill library to co‑evolve with the agent’s policy during reinforcement learning. These techniques reduce token usage and improve reasoning, achieving state‑of‑the‑art results on ALFWorld, WebShop, and seven search‑augmented tasks, outperforming baselines by 15.3% and remaining robust as task complexity grows.

Machine-generated by The Flow from the publisher's headline and feed description — not written or checked by a human. The full article lives at arXiv Machine Learning.

Related stories

arXiv Machine Learning
Jul 30

SkillRise: Agentic Reinforcement Learning for Cross-Task Skill Evolution

arXiv:2607. 26784v1 Announce Type: new Abstract: Large language model agents often encounter related yet distinct tasks that share reusable solution patterns.

By Zhiyuan Yao, Yuxin Chen, Zhengxi Lu, Zishan Xu, Yueqing Sun, Yifu Guo, Yuquan Lu, Zhengzhou Cai, Kangning Zhang, Zhuowen Han, Zi-Han Wang, Ziang Ye, Qi Gu, Xunliang Cai, Weiwen Liu, Yongliang Shen
llmsagentsreinforcement-learning
More like this →
arXiv Computation and Language
1d ago

SkillGraph: Skill-Augmented Reinforcement Learning for Agents via Evolving Skill Graphs

SkillGraph introduces a skill library framework that models reusable skills as nodes in a directed graph, with typed edges representing prerequisite, enhancement, and co-occurrence relationships. When presented with a new task, the system retrieves an ordered subgraph of relevant skills, guiding multi-step decision making. The graph is continuously refined through agent trajectories and reinforcement learning, enabling simultaneous improvement of the skill library and the agent policy, and achieving state‑of‑the‑art results on ALFWorld, WebShop, and several search‑augmented QA tasks.

By Xiaoyuan Li, Moxin Li, Keqin Bao, Yubo Ma, Wenjie Wang, Dayiheng Liu, Fuli Feng
llmsagentsreinforcement-learningbenchmarks
More like this →
Hugging Face Trending Papers
Jul 29

SkillRise: Agentic Reinforcement Learning for Cross-Task Skill Evolution

Large language model agents often encounter related yet distinct tasks that share reusable solution patterns. Yet standard agentic reinforcement learning treats tasks as independent episodes, while existing approaches to skill learning either focus on repeated attempts of one task or use pipelines with multiple stages that entangle extraction, retrieval, and execution.

llmsagentsreinforcement-learning
More like this →
arXiv AI
Sep 3

APEx: Distillation of Agent Procedural Experience for Adaptive Deep Research Question Answering

APEx is a hierarchical framework that organizes a deep research agent’s interaction history into instance-level trajectory memories and category-level procedural skills. It couples these through an Executor, Distiller, and Planner, trained with a three-stage alternating GRPO paradigm to enable reward-guided skill distillation. At test time, distilled skills act as procedural priors for online Planner adaptation via skill-guided reinforcement learning, achieving state‑of‑the‑art results on seven benchmarks, outperforming GPT‑5.4 by 14.7 points and the best memory‑augmented baseline by 3.0 points.

By Jie Ding, Rui Sun, Xinyuan Zhang, Zeyu Zhang, Xin Liu
llmsagentsnlpreinforcement-learningefficiencybenchmarkssafety
More like this →