arXiv AI

Do Self-Evolving Skills Generalize to Held-Out Tasks?

arXiv AI
Oct 16

SkillNEO: Non-Elitist Evolutionary Optimization of Agent Skills

SkillNEO introduces a non‑elitist evolutionary framework for refining agent skills, allowing lower‑reward versions to receive further edits and preserve useful partial repairs. By separating the selection of a version to use from the selection of versions to improve, the method identifies which steps to keep and which failures to fix, even revisiting earlier versions with new evidence. Experiments on 86 SkillsBench tasks across eight domains show significant reward gains for GPT‑5.4 Mini and substantial improvements when the evolved skills are reused by stronger models such as GPT‑5.5 and GPT‑5.6 Luna.

By Enze Ma, Chunyu Miao, Yankai Chen, Jie Yang, Liancheng Fang, Kening Zheng, Hanrong Zhang, Muyao Xu, Xinle Yu, Chengze Li, Wei-Chieh Huang, Ziwei Ren, Yunhao Du, Zhixiang Shen, Xue Liu, Philip S. Yu, Zhen Wang
arXiv Machine Learning
Oct 16

CausalEvo: Causal Skill Self-Evolution for Health LLM Agents

CausalEvo is a method that enables large language model agents in health to evolve their textual skills—such as calculation rules and measurement units—by evaluating the causal impact of skill changes while keeping model weights, feedback cases, and rule count constant. The approach freezes the LLM to propose candidate rules, pools them with existing skills, and uses paired skill replacements scored on shared feedback to rank and retain the most effective rules. In experiments on six MedCalc-Bench-Verified tasks, CausalEvo achieved 60.00% accuracy, outperforming SkillOpt (55.83%) and a no‑skill baseline (51.67%), while also reducing training token usage by 55.6%. whyItMatters":"CausalEvo demonstrates that controlled, causal evaluation of skill updates can improve health‑focused LLM performance and efficiency, directly benefiting the reliability and resource usage of medical language agents."

By Yuchen Zhang
Hugging Face Trending Papers
Jun 10

SkillJuror: Measuring How Agent Skill Organization Changes Runtime Behavior

Agent Skills augment large language model (LLM) agents with procedural knowledge at inference time, but current benchmarks rarely distinguish what a Skill says from how it is organized. We study this distinction through Progressive Disclosure, where a concise root file points agents to supporting resources on demand, and compare it with a normalized flat baseline.

arXiv AI
Oct 5

VERSE: Verified Self-Evolving Optimizer for Agent Harnesses

The paper introduces VERSE, a Verified Self‑Evolving optimizer that enhances LLM agent harnesses by allowing the optimizer to test edits, replay failures, and perturb steps while tracking fixes and regressions. VERSE builds its own tools for failure analysis, verification, training audits, and workflow control, and uses this feedback to revise the harness’s prompts, skills, tools, hooks, and notes without changing model weights. In experiments across five executors and multiple languages, VERSE improves all evaluated harness optimizers, achieving higher accuracy on held‑out and out‑of‑distribution tasks compared to the strongest baselines.

By Zekai Wang, Yingqiang Ge, Zekun Wang, Hai Wang, Yuhui Xu, Joshua Frandsen, Shancong Fu, Ashia C. Wilson, Chandan K. Reddy