arXiv Computation and Language

From Procedural Skills to Strategy Genes: Towards Experience-Driven Test-Time Evolution

arXiv Computation and Language
Aug 25

LongWoF-Bench: Evaluating EvoMap Genes for Verifiable Long-Workflow Tasks

LongWoF-Bench is a new benchmark of 778 machine‑verifiable long‑workflow tasks spanning code generation, agent‑environment synthesis, mathematical reasoning, and rule following. The study shows that EvoMap Genes—structured representations of verifier‑confirmed execution trajectories—outperform the Skill baseline by 8.7–15.5 percentage points across seven models, and for Claude Opus they enable 39 additional task completions while cutting token consumption by 9.9%. The results demonstrate that verified execution experience can be externalized and reused, improving long‑workflow completion without repeatedly discovering new strategies.

By Xiao Zhang, Qumeng Sun, Jihao Li, Yiming Ren, Xiang Liu, Haoyang Zhang, Junjie Wang
arXiv AI
4d ago

Evolver: Turning Agent Exploration into Evolving Capabilities

Evolver is an experience-driven framework that converts agent exploration into persistent, reusable capabilities without updating foundation model parameters. It uses structured Gene assets to acquire, retrieve, and evolve experience, enabling experience-conditioned execution across existing agent harnesses. In evaluations with Claude Code and Codex on several benchmarks, Evolver increased task success from 83.13% to 87.50% and reduced token consumption by up to 24.24%, showing both effectiveness and efficiency gains.

By Haoyang Zhang, Qumeng Sun, Xiao Zhang, Xiang Liu, Zhidong Fan, Junjie Wang
arXiv Computation and Language
Oct 27

Hierarchical Skill Evolution for Coding Agent

arXiv:2610.35616v1 Announce Type: new Abstract: Skills provide agents with reusable experience to guide future decisions without modifying the underlying model. However, coding trajectories are often...

By Jun Gao, Yun Peng, Changhai Zhou, Yuhan Zhu, Xiangyu Zeng, Shiyang Zhang Yuhua Zhou, Luozheng Qin, Qian Qiao, Xiaoteng Ma, Baian Chen Weiyi Shang, Zhen Ming Jack Jiang, Lizhi Liao, Xiaoxue Ren
arXiv AI
Jun 2

BenchEvolver: Frontier Task Synthesis via Solution-Centric Evolution

arXiv:2606. 01286v1 Announce Type: cross Abstract: The rapid progress of frontier large language models has led to widespread benchmark saturation, limiting the ability of existing datasets to differentiate model capabilities or provide useful training signal.

By Yangzhen Wu, Aaron J. Li, Wenjie Ma, Li Cao, Ziheng Zhou, Mert Cemri, Shu Liu, Yuran Xiu, Chenxiao Yan, Haikun Zhao, Bin Yu, Ion Stoica, Dawn Song
arXiv AI
Sep 7

From Interaction Traces to Persistent Skills: Online Evolution for Computer-Use Agents

The paper introduces an online skill‑evolution framework that transforms interaction traces and evaluator feedback into a persistent, versioned library of reusable procedures for computer‑use agents. By executing each iteration against a frozen library snapshot, the system updates skills without altering the underlying model parameters. Experiments across four OSWorld domains show that the evolving library consistently outperforms an empty‑library baseline, with gains ranging from 5.7 to 18.6 percentage points, while also revealing domain‑specific temporal stability and challenges in skill retrieval and revision.

By Longtao Hu, Xiao Liang, Linchao Zhu
arXiv AI
Oct 21

VisualEvolve: A Skill Self-Evolution Framework for Visual Reasoning

arXiv:2610.28386v1 Announce Type: cross Abstract: Visual tool use enables vision-language models (VLMs) to acquire task-relevant evidence, but its effectiveness can be limited by predefined visual op...

By Jiawei Wang, Yucun Li, Xueqi Li, Shenghao Wang, Xinquan Gong, Dan Zhang, Zheqi Lv, Yuquan Le, Shaozu Yuan, An Zhang, Da Cao, Tat-Seng Chua
arXiv AI
Oct 16

SkillNEO: Non-Elitist Evolutionary Optimization of Agent Skills

SkillNEO introduces a non‑elitist evolutionary framework for refining agent skills, allowing lower‑reward versions to receive further edits and preserve useful partial repairs. By separating the selection of a version to use from the selection of versions to improve, the method identifies which steps to keep and which failures to fix, even revisiting earlier versions with new evidence. Experiments on 86 SkillsBench tasks across eight domains show significant reward gains for GPT‑5.4 Mini and substantial improvements when the evolved skills are reused by stronger models such as GPT‑5.5 and GPT‑5.6 Luna.

By Enze Ma, Chunyu Miao, Yankai Chen, Jie Yang, Liancheng Fang, Kening Zheng, Hanrong Zhang, Muyao Xu, Xinle Yu, Chengze Li, Wei-Chieh Huang, Ziwei Ren, Yunhao Du, Zhixiang Shen, Xue Liu, Philip S. Yu, Zhen Wang