arXiv AI

SkillLift: Learning Dense Rubrics from Sparse Oracles for Efficient Skill Evolution

SkillLift introduces a method for efficiently evolving reusable procedural prompts (skills) in large language model agents by learning a dense rubric that aligns with sparse oracle evaluations. Instead of directly revising skill text based on costly full agent rollouts, the approach decouples skill search from oracle cost through a bilevel optimization framework: an inner loop uses a frozen rubric as a cheap surrogate to guide skill updates, while an outer loop periodically realigns the rubric using a small number of oracle rollouts via rank correlation. Experiments on complex agent task benchmarks demonstrate that SkillLift outperforms existing auto-skill methods while reducing token cost by 40–70% compared to frontier-evolving approaches.

arXiv AI
Jul 29

DecoEvo: Score-Decoupled Co-Evolution of Solver and Rubric-Generator Skills in Text Space

arXiv:2607. 25675v1 Announce Type: new Abstract: Text-space optimization adapts large language models (LLMs) by editing external natural-language artifacts rather than model weights, so the optimized artifacts remain inspectable and the model can be treated as a black box.

By Jiangwang Chen, Zixin Song, Junlin Liu, Shuaiyu Zhou, Haiyan Wu, Haihan Shi, Chenxi Zhou, Hanqing Li, Xiao Yang, Da Zhu, Guanjun Jiang, Hai Wan, Xibin Zhao
arXiv AI
Oct 1

Self-Evolving Harness on Multiple Tasks with the Agent as Its Own Optimizer

The paper introduces a self‑evolving harness framework where a frozen language‑model agent first solves tasks and then edits its own harness based on run records. Using a 49‑line seed harness, the evolved harness improves average scores on in‑distribution benchmarks by 4.48 points and on out‑of‑distribution benchmarks by 12.64 points, surpassing Codex on the former and matching it on the latter. Continued evolution on a specific out‑of‑distribution benchmark further raises performance, and the study analyzes emergent mechanisms such as output truncation and history compaction.

By Qiankai Xu