EconSkills is a skill library and evaluation framework that transforms verified EconWebArena trajectories into parameterized standard operating procedures for retrieving live economic data. Each skill captures scope, navigation steps, site-specific guidance, verification checks, and recovery steps, replacing instance-specific values with placeholders. The framework evaluates skill transfer to new tasks and the effectiveness of library retrieval, showing that matched skills improve success rates and reduce steps compared to no-skill prompting, while abstraction outperforms raw trajectory replay. At scale, retrieval performs competitively overall, excelling on directly covered tasks and compensating for uncovered tasks through approximate matches.
arXiv:2606. 04391v1 Announce Type: new Abstract: Language agents increasingly rely on reusable skills to improve multi-step web automation across related tasks.
arXiv:2610.35823v1 Announce Type: new Abstract: Browser agents do not just need more practice. They need to practice the right things. We introduce MiniWeb, a realistic miniature of the web comprisin...
arXiv:2606. 08671v1 Announce Type: new Abstract: Agent skills extend language-model agents with task-specific procedures, scripts, and references, but the tasks and environments they target continually change.
arXiv:2605. 18401v2 Announce Type: replace-cross Abstract: Long-horizon LLM agents generate traces that could become reusable experience, but raw trajectories are noisy, local, and hard to govern.
Agent Skills package procedural guidance and resources for reuse, but a relevant Skill does not necessarily improve task performance. Existing studies characterize Skill content and evaluate downstrea...
arXiv:2606. 17645v1 Announce Type: new Abstract: Large language model (LLM) web agents are usually deployed as tool callers: each turn, the model reads a fresh page observation and emits one structured tool action.
SkillCT is a new benchmark that expands agent skill assessment beyond downstream task execution to a multidimensional evaluation across nine dimensions grouped into Static, Dynamic, and Human-Assisted assessments. It measures specification quality, behavioral robustness, semantic alignment, and responsibility boundaries without requiring repeated executions. The benchmark also introduces an execution-free baseline that predicts skill quality profiles by comparing to similar reference skills, reducing token usage and evaluation time while enabling skill refinement and repository maintenance.
SkillShift-Bench is a new benchmark that evaluates web agents’ skill learning under controlled open-environment shifts, including Contextual, Perceptual, and Execution shifts across three self-hosted web systems. It measures task success, interaction cost, skill use, and skill failure, revealing that skill robustness degrades systematically—especially under Execution Shift. The benchmark also frames shifted skill execution as a nonstationary local executability problem, offering a dynamic-regret analysis and a test-time adaptation method to improve skill execution without relearning.
arXiv:2610.16319v1 Announce Type: new Abstract: Real-world hybrid web tasks need both information gathering and page interaction, yet search-based and operation-based agents are developed and evaluat...
Skill‑V is a verifiable self‑evolving skill library for interactive agents that represents skills as versioned, falsifiable contracts linking semantic intent to observable behavior. The system uses task failures to add new skills and contract‑outcome disagreements to revise existing skill boundaries, ensuring revisions preserve semantic constraints and pass non‑regression tests on historical evidence. An applicability‑aware filter excludes confidently inapplicable skill candidates, leading to high success rates on ALFWorld (95.3%) and WebShop (85.9%) while keeping the library more compact than growth‑only baselines.
SkillGym is an automatic pipeline that generates verifiable environments for training skill-use agents. It crawls internet skills, filters for reproducible workflows, and uses a builder‑reviewer process to create difficulty‑controlled tasks with reference solutions and verifiers. The system builds 6.8k environments, collects 19k successful trajectories, and fine‑tunes LLMs from 2B to 122B parameters, improving performance and skill invocation rates.
arXiv:2610.08875v1 Announce Type: cross Abstract: Agent Skills package procedural guidance and resources for reuse, but a relevant Skill does not necessarily improve task performance. Existing studie...