arXiv AI

WikiSkill: Compiling Agent Experience into Persistent Knowledge for Skill Evolution

WikiSkill is a framework that separates raw execution experience, accumulated knowledge, and executable skills, continuously consolidating experience into a persistent knowledge base (wiki). By co‑evolving agent skills with this wiki, the method consistently outperforms state‑of‑the‑art skill‑evolution techniques across diverse benchmarks and models. The study shows that larger models benefit more from evolved skills, smaller models can outperform larger ones when equipped with skills, and that skills transfer effectively across model families, with the wiki’s persistent knowledge being critical for success.

arXiv AI
Jun 17

A Framework for Evaluating Agentic Skills at Scale

arXiv:2606. 17819v1 Announce Type: cross Abstract: Agent skills -- structured, reusable knowledge artifacts that augment LLM agent capabilities -- have been rapidly adopted in industry, yet their cross-domain impact and use across commercial and open-source models remain under-studied, and no reusable methodology exists for evaluating an individual skill.

By Maksim Shaposhnikov, Nicolas Fortuin, Simon Stipcich, Maria I. Gorinova, Amy Heineike, Rob Willoughby
arXiv AI
Aug 20

SkillNet: Create, Evaluate, and Connect AI Skills

SkillNet is an open infrastructure that enables the creation, evaluation, and organization of AI skills at scale. It structures skills within a unified ontology, supports multi‑dimensional evaluation (Safety, Completeness, Executability, Maintainability, Cost‑awareness), and integrates a repository of over 600,000 skills, an interactive platform, and a Python toolkit. Experiments on ALFWorld, WebShop, and ScienceWorld demonstrate a 40% increase in average rewards and a 30% reduction in execution steps across multiple backbone models.

By Yuan Liang, Ruobin Zhong, Haoming Xu, Chen Jiang, Yi Zhong, Runnan Fang, Jia-Chen Gu, Shumin Deng, Yunzhi Yao, Mengru Wang, Shuofei Qiao, Yida Xue, Xin Xu, Tongtong Wu, Kun Wang, Yang Liu, Zhen Bi, Jungang Lou, Yuchen Eleanor Jiang, Hangcheng Zhu, Gang Yu, Haiwen Hong, Longtao Huang, Hui Xue, Chenxi Wang, Yijun Wang, Zifei Shan, Xi Chen, Zhaopeng Tu, Feiyu Xiong, Xin Xie, Peng Zhang, Zhengke Gui, Lei Liang, Jun Zhou, Chiyu Wu, Jin Shang, Yu Gong, Junyu Lin, Changliang Xu, Hongjie Deng, Wen Zhang, Keyan Ding, Qiang Zhang, Fei Huang, Ningyu Zhang, Jeff Z. Pan, Guilin Qi, Haofen Wang, Huajun Chen
arXiv AI
Jun 6

Trace2Skill: Distill Trajectory-Local Lessons into Transferable Agent Skills

arXiv:2603. 25158v5 Announce Type: replace Abstract: Large Language Model (LLM) agents increasingly rely on domain-specific skills, yet manually authoring such skills does not scale, and skills generated purely from parametric knowledge often miss critical operational pitfalls.

By Jingwei Ni, Yihao Liu, Xinpeng Liu, Yutao Sun, Mengyu Zhou, Pengyu Cheng, Dexin Wang, Erchao Zhao, Xiaoxi Jiang, Guanjun Jiang
arXiv AI
Sep 7

From Interaction Traces to Persistent Skills: Online Evolution for Computer-Use Agents

The paper introduces an online skill‑evolution framework that transforms interaction traces and evaluator feedback into a persistent, versioned library of reusable procedures for computer‑use agents. By executing each iteration against a frozen library snapshot, the system updates skills without altering the underlying model parameters. Experiments across four OSWorld domains show that the evolving library consistently outperforms an empty‑library baseline, with gains ranging from 5.7 to 18.6 percentage points, while also revealing domain‑specific temporal stability and challenges in skill retrieval and revision.

By Longtao Hu, Xiao Liang, Linchao Zhu