arXiv AI

The Router Within: Eliciting Native Skill Routing from a Frozen LLM

arXiv AI
Sep 30

SkillGym: Training Skill-Use Agents with Automatic Verifiable Environment Generation

SkillGym is an automatic pipeline that generates verifiable environments for training skill-use agents. It crawls internet skills, filters for reproducible workflows, and uses a builder‑reviewer process to create difficulty‑controlled tasks with reference solutions and verifiers. The system builds 6.8k environments, collects 19k successful trajectories, and fine‑tunes LLMs from 2B to 122B parameters, improving performance and skill invocation rates.

By Renxi Wang, Mingshan Hee, Fajri Koto, Timothy Baldwin, Haonan Li
arXiv AI
Sep 28

SkillFlow: Scalable and Efficient Agent Skill Retrieval System

SkillFlow is an open, multi-stage retrieval system that helps AI agents selectively load relevant skills from a large library of community-contributed SKILL.md definitions. The pipeline uses dense retrieval, two rounds of cross-encoder reranking, and LLM-based selection to balance recall and precision. Evaluations on SkillsBench and Terminal-Bench show that SkillFlow improves performance when high-quality skills are available, but retrieval alone does not help if the corpus lacks executable skills for the target domain.

By Fangzhou Li, Pagkratios Tagkopoulos, Ilias Tagkopoulos
arXiv Machine Learning
3d ago

TalentRL: Strategy-Guided Reinforcement Learning for Hierarchical Skill Routing

TalentRL is a strategy‑guided reinforcement learning framework that routes natural‑language skills hierarchically, using coarse‑grained talents to guide fine‑grained skill retrieval. The method trains talent routing via reward contrasts and optimizes execution with group‑relative advantages, achieving significant performance gains on open‑domain QA benchmarks and agentic tasks such as ALFWorld and WebShop.

By Huancheng Chen, Xiaodi Sun, Zhaoqiong Huang, Michelle Chang, Jingwen Lu
arXiv Computation and Language
1d ago

Learning by Doing: Autonomously Compiling and Curating Agent Skills from Verified Traces

The paper introduces Zep Agent Skills, a production service that autonomously compiles and curates procedural memory for large language model agents by converting verified execution traces into versioned skills. It records each task attempt as a trace, uses a compiler with Reflector and Curator roles to transform verified traces into skills, and applies admission gates and search ranking based on verified outcomes. The open Agent Skills format, originally from Anthropic, allows any host to load compiled skills, and evaluation on several benchmarks shows significant performance gains for weaker executor models without additional training.

By Daniel Chalef, Peter Evans, Pavlo Paliychuk, Mehul Patel, Preston Rasmussen, Jack Ryan
arXiv AI
Aug 24

Representation Affects Retrieval: A Case Study of Skill Discovery and Routing in a Multimodal Agent Harness

The paper examines how skill representations influence selection in a multimodal video agent harness called Tinycloud. It compares two types of skill representations—tool-skills and workflow-skills—and two prompt surfaces—full inlined bodies and one-line listings—across three exposure regimes. The study finds that full autoload exposure consistently selects the correct skill, while partial exposure can cause lexical competition that misroutes tasks, highlighting that in-prompt exposure is not always beneficial.

By Kevin Dela Rosa
arXiv Computation and Language
1d ago

Skill++: Towards Lifelong Agents via Routing-Aware Skill Refinement

Skill++ addresses lifelong skill routing for large language model agents by rewriting the name and description of each new skill instead of retraining the router. This approach preserves earlier skills while allowing new ones to be selected, achieving 76.3% query success versus 36.4% with original metadata across a library of 731 skills. It outperforms existing methods on three benchmarks and five LLM routers, and its benefits transfer to the Codex CLI agent harness.

By Hanrong Zhang, Minghao Liang, Jiawei Wu, Yankai Chen, Shicheng Fan, Zhiwei Liu, Enze Ma, Junwei Yuan, Tianyi Wang, Dehai Min, Kening Zheng, Xue Liu, Philip S. Yu