arXiv AI By Bo-Yu Chen, Zhi Zhou, Yu-Feng Li

SkillShift-Bench: Benchmarking Skill Learning under Environment Evolution for Web Agents

Read the original on arXiv AI →

SkillShift-Bench is a new benchmark that evaluates web agents’ skill learning under controlled open-environment shifts, including Contextual, Perceptual, and Execution shifts across three self-hosted web systems. It measures task success, interaction cost, skill use, and skill failure, revealing that skill robustness degrades systematically—especially under Execution Shift. The benchmark also frames shifted skill execution as a nonstationary local executability problem, offering a dynamic-regret analysis and a test-time adaptation method to improve skill execution without relearning.

Machine-generated by The Flow from the publisher's headline and feed description — not written or checked by a human. The full article lives at arXiv AI.

arXiv AI
Sep 1

WebXSkill: Skill Learning for Autonomous Web Agents

arXiv:2604.13318v2 Announce Type: replace Abstract: Autonomous web agents powered by large language models (LLMs) remain brittle on long-horizon browser workflows. A key bottleneck is a grounding gap...

By Zhaoyang Wang, Qianhui Wu, Xuchao Zhang, Chaoyun Zhang, Wenlin Yao, Fazle Elahi Faisal, Baolin Peng, Si Qin, Suman Nath, Qingwei Lin, Chetan Bansal, Dongmei Zhang, Saravan Rajmohan, Jianfeng Gao, Huaxiu Yao
arXiv AI
Sep 10

SCAFFOLD: Self-Improving Web Agents via Recursive Parametric Skill Abstraction

SCAFFOLD is a self‑improving framework for visual web agents that automatically induces parametric, executable skills from successful trajectories and organizes them into a recursively composed hierarchy. It compresses the skill library using a minimum‑description‑length criterion and behavioral equivalence checks, and periodically distills these skills back into model weights to internalize the abstractions. Experiments on WebArena, VisualWebArena, and Online‑Mind2Web show that SCAFFOLD raises success rates by 11.1–17.2 absolute points over the best skill‑augmented baseline and continues to improve across five self‑improvement iterations without collapsing the library.

By Bowei He, Xiaokun Zhang, Meng Ding, Xue Liu