Davinci-Tool: Scaling Agentic Tool-Use Supervision with Verifiable Executable Environments
Read the original on arXiv AI →The Flow has not summarised this story yet — read it at arXiv AI.
The Flow has not summarised this story yet — read it at arXiv AI.
The paper introduces a self‑supervised framework called software‑in‑the‑loop reconstruction (SWR) that automatically generates reference outputs and verification targets for terminal agents by leveraging existing scientific software workflows. SWR executes multiple input configurations, partitions cases into public observations and hidden evaluations, and uses a hierarchical verifier to assess agent‑generated programs against hidden workflow outputs. The authors demonstrate the approach on 500 workflows across six domains, achieving significant performance gains on the Terminal‑Bench 2 benchmark with the Qwen3.8‑Max and Qwen3.8‑27B models.
DAGent introduces an Evaluate‑then‑Grow planning approach for deep research agents, building directed acyclic graphs incrementally based on confidence and uncertainty from completed tasks. The framework includes a hierarchical context layer for efficient query handling and a structural reinforcement learning component, DAGRPO, that rewards topology‑conditioned execution. Experiments on BrowseComp‑Plus, GAIA, and xbench‑DeepSearch show DAGent outperforming strong baselines across multiple backbones and scaling to large language models.
arXiv:2609.36887v1 Announce Type: new Abstract: Recent efforts to scale tool-use post-training have largely centered on the synthesis of executable environments, which constitute only one component o...
DynaWeave is an automated framework that converts static tasks into dynamic scenarios by generating exogenous events and using DAGs to manage dependencies. It activates these events during agent interaction and employs a dynamic verifier that updates only relevant evaluation checks. Using DynaWeave, the authors collected over 2,000 verified trajectories, fine‑tuned Qwen3.5 models, and achieved significant performance gains on Gaia2, CostBench, and ToolMaze, even surpassing Gemini‑3.1‑Pro‑Preview on ToolMaze.
Interlock is a framework that transforms long‑horizon tasks into typed completion graphs, linking evidence, decisions, and required effects through grounding, coupling, and realization edges. It compiles these graphs into a resettable workspace, a public request, and an evaluation rubric, and uses source‑coverage, public‑input, and agent‑as‑judge reviews to ensure that all mandatory requirements are met. Fine‑tuning Qwen3.6 backbones on Interlock‑generated trajectories improves pass rates on AutomationBench, JobBench, and Harvey LAB, showing that the synthesized experience benefits external task environments.
The paper introduces TerminalHorizon, an automated engine that synthesizes long‑horizon trajectories for terminal agents by reconstructing environments from real‑world professional work and progressively expanding tasks to require further exploration and improvement. Using this engine, the authors create 1.5K task environments and fine‑tune Qwen3.5‑27B, producing TerminalHorizon‑27B, which shows significant performance gains across 12 benchmarks in coding, agentic production tasks, and reasoning. Case studies demonstrate the model’s ability to experiment beyond initial solutions, refine methods based on feedback, and preserve effective improvements in final deliverables.