$\Delta\tau$-Bench: Pushing Agents Toward a Moving Capability
Read the original on arXiv AI →The Flow has not summarised this story yet — read it at arXiv AI.
The Flow has not summarised this story yet — read it at arXiv AI.
EVOHARNESSBENCH is a new benchmark that tests how LLM-based agents handle changes in their tool, skill, and agent harnesses over time. It includes 17 deterministic harness streams with 802 tasks, 520 tools, 42 skills, and 62 agents, and evaluates agents in two settings: deployment evaluation and self‑evolving adaptation evaluation. The study finds that harness expansion can cause forgetting, adaptation gains are inconsistent, and preserving old competence does not always aid new capability adaptation, highlighting harness evolution as a distinct challenge for agent development.
arXiv:2609.04280v2 Announce Type: replace-cross Abstract: Modern LLM-based agents operate through a harness of tools, reusable skills, and specialist agents that shapes what they observe and what the...
arXiv:2610.08875v1 Announce Type: cross Abstract: Agent Skills package procedural guidance and resources for reuse, but a relevant Skill does not necessarily improve task performance. Existing studie...
arXiv:2604. 08377v2 Announce Type: replace Abstract: Large language model (LLM) agents such as OpenClaw rely on reusable skills to perform complex tasks, yet these skills remain largely static after deployment.
Agent Skills package procedural guidance and resources for reuse, but a relevant Skill does not necessarily improve task performance. Existing studies characterize Skill content and evaluate downstrea...
AgentEvolver is a system that enables agents to develop reusable capabilities while executing tasks, without altering the underlying foundation model. It uses eight entity families to expose operations, methods, agents, control flow, interfaces, and state for revision, coordinated by a shared Runtime and persistent planning. In evaluations on SWE-bench Pro Public, it achieved an 82.08% resolution rate, demonstrating retained capabilities across subsequent website, game, and research tasks, though some objectives remained incomplete.