arXiv Computation and Language By Qi Shen, Ziyue Zhu, Yongqing Jiang, Zhen Xia, Li Shengjie, Shuai Zhao, Bo Cheng, Xiaobao Wu, Anh Tuan Luu, Haoran Luo

CompSkill: Compiling Execution Experience for Skill Retrieval

Read the original on arXiv Computation and Language →

CompSkill is a system that improves skill retrieval for large‑language‑model agents by indexing skills with learned 512‑dimensional keys and compiling execution experience into skill offsets and capped key residuals (KeyOpt). This approach allows the system to adjust which skill document is presented to the executor based on prior execution outcomes, rather than relying solely on skill descriptions. Experiments on ToolQA, AppWorld, and ALFWorld show that CompSkill raises SkillRet NDCG@10 from 64.0 to 70.9 and achieves higher completion rates than all baselines, demonstrating the value of incorporating execution experience into skill retrieval. whyItMatters":"By using execution experience to guide skill selection, CompSkill enhances the effectiveness of LLM agents on complex task suites, outperforming existing retrieval methods and highlighting the importance of experience‑aware retrieval in practical AI systems."

Machine-generated by The Flow from the publisher's headline and feed description — not written or checked by a human. The full article lives at arXiv Computation and Language.

arXiv AI
Oct 9

One Skill Too Many: How Co-Installed Skills Conflict in Coding Agents

The paper investigates how co-installed coding‑agent skills can conflict, causing the model to choose a similar skill over the intended one based solely on name and description. An empirical study of 20,947 repositories uncovered 822,109 candidate skill pairs, with 312 confirmed conflicts tested across three models, revealing that nearly one in four installed skills is overridden by a similar skill. Key findings include that conflicts often involve normative skills, that the installed skill loses core functions in about one‑fifth of runs, and that the first skill read determines the outcome, suggesting benchmarks should evaluate exclusive core functions and platforms should guard the initial read.

By Chaoliang Yan, Zihao Xu, Yuekang Li, Shangzhi Xu, Yi Liu, Gelei Deng, Siqi Ma
arXiv AI
Oct 12

Locate, Judge, Read: Role-Specialized Tool Agents over a Knowledge-Point Index for Open-Domain Multimodal Document QA

KnowForge is a modular pipeline for open‑domain multimodal document question answering that separates retrieval, judging, and reading into distinct agents. It uses a hybrid‑retrieval knowledge‑point index, a Locator agent for searching, a Bridge Judge to enforce a second hop, a Deep Reader that handles text, images, and tables, and a synthesizer with format checking. On the M3DocVQA benchmark it achieves an F1 of 47.5, outperforming prior systems by 11 points, and shows strong gains on MultiHop‑RAG and MMLongBench‑Doc as well.

By Wenlin Lin, Fanzhe Wei
arXiv AI
Jun 3

SkillDAG: Self-Evolving Typed Skill Graphs for LLM Skill Selection at Scale

arXiv:2606. 03056v1 Announce Type: new Abstract: As LLM agents adopt large skill libraries, selecting the right subset becomes a structural problem rather than a similarity-matching one: skills depend on, conflict with, specialize, or duplicate one another, a structure invisible to both full enumeration and embedding similarity.

By Tong Bai, Zhenglin Wan, Pengfei Zhou, Xingrui Yu, Wangbo Zhao, Yang You, Ivor W. Tsang
arXiv AI
Oct 9

Right Family, Wrong Skill: Evaluating Risk Exposure in Agent Skill Retrieval

The paper introduces SameCapRisk-Bench, a dataset of 890 skill units and 1,314 query cases that pair a skill matching a task’s requirements with a same‑capability skill that violates them. It evaluates public skill retrievers on metrics that capture both successful retrieval (Recall) and exposure to conflicting siblings (HSR and CleanHit), finding high rates of harmful sibling exposure. The study also shows that increasing the reranker’s input budget can reduce sibling‑first errors, though CleanHit gains remain uncertain.

By Jiandong Ding, Honglei Ji, Ming Liu, Tao Duan
arXiv AI
Sep 28

SkillFlow: Scalable and Efficient Agent Skill Retrieval System

SkillFlow is an open, multi-stage retrieval system that helps AI agents selectively load relevant skills from a large library of community-contributed SKILL.md definitions. The pipeline uses dense retrieval, two rounds of cross-encoder reranking, and LLM-based selection to balance recall and precision. Evaluations on SkillsBench and Terminal-Bench show that SkillFlow improves performance when high-quality skills are available, but retrieval alone does not help if the corpus lacks executable skills for the target domain.

By Fangzhou Li, Pagkratios Tagkopoulos, Ilias Tagkopoulos