Elicitation or Expansion? Demystifying Gains from Agent Harness Optimization

The paper investigates how optimizing the harness of language model agents—without changing model weights—affects performance. It distinguishes between gains that improve success on tasks already within reach (elicitation) and gains that broaden the range of solvable tasks (expansion). By comparing optimized harnesses to their pre‑optimization versions across static and dynamic tasks, the study finds that benefits can reverse at higher attempt budgets and that aggregate gains may mask shortcomings on harder tasks, highlighting the need for detailed diagnostics.

Machine-generated by The Flow from the publisher's headline and feed description — not written or checked by a human. The full article lives at arXiv Machine Learning.

• llms
• agents
• reinforcement-learning