arXiv AI By Yuan Liang, Ruobin Zhong, Haoming Xu, Chen Jiang, Yi Zhong, Runnan Fang, Jia-Chen Gu, Shumin Deng, Yunzhi Yao, Mengru Wang, Shuofei Qiao, Yida Xue, Xin Xu, Tongtong Wu, Kun Wang, Yang Liu, Zhen Bi, Jungang Lou, Yuchen Eleanor Jiang, Hangcheng Zhu, Gang Yu, Haiwen Hong, Longtao Huang, Hui Xue, Chenxi Wang, Yijun Wang, Zifei Shan, Xi Chen, Zhaopeng Tu, Feiyu Xiong, Xin Xie, Peng Zhang, Zhengke Gui, Lei Liang, Jun Zhou, Chiyu Wu, Jin Shang, Yu Gong, Junyu Lin, Changliang Xu, Hongjie Deng, Wen Zhang, Keyan Ding, Qiang Zhang, Fei Huang, Ningyu Zhang, Jeff Z. Pan, Guilin Qi, Haofen Wang, Huajun Chen

SkillNet: Create, Evaluate, and Connect AI Skills

Read the original on arXiv AI →

SkillNet is an open infrastructure that enables the creation, evaluation, and organization of AI skills at scale. It structures skills within a unified ontology, supports multi‑dimensional evaluation (Safety, Completeness, Executability, Maintainability, Cost‑awareness), and integrates a repository of over 600,000 skills, an interactive platform, and a Python toolkit. Experiments on ALFWorld, WebShop, and ScienceWorld demonstrate a 40% increase in average rewards and a 30% reduction in execution steps across multiple backbone models.

Machine-generated by The Flow from the publisher's headline and feed description — not written or checked by a human. The full article lives at arXiv AI.

arXiv AI
Jun 17

A Framework for Evaluating Agentic Skills at Scale

arXiv:2606. 17819v1 Announce Type: cross Abstract: Agent skills -- structured, reusable knowledge artifacts that augment LLM agent capabilities -- have been rapidly adopted in industry, yet their cross-domain impact and use across commercial and open-source models remain under-studied, and no reusable methodology exists for evaluating an individual skill.

By Maksim Shaposhnikov, Nicolas Fortuin, Simon Stipcich, Maria I. Gorinova, Amy Heineike, Rob Willoughby
arXiv AI
Aug 28

WikiSkill: Compiling Agent Experience into Persistent Knowledge for Skill Evolution

WikiSkill is a framework that separates raw execution experience, accumulated knowledge, and executable skills, continuously consolidating experience into a persistent knowledge base (wiki). By co‑evolving agent skills with this wiki, the method consistently outperforms state‑of‑the‑art skill‑evolution techniques across diverse benchmarks and models. The study shows that larger models benefit more from evolved skills, smaller models can outperform larger ones when equipped with skills, and that skills transfer effectively across model families, with the wiki’s persistent knowledge being critical for success.

By Liyan Tang, Cyrus Rashtchian, Chun-Sung Ferng, Andrew Tomkins, Da-Cheng Juan, Tu Vu