arXiv AI

The Handoff Tax: Continuing Non-Native Trajectories in LLM Agents

The paper investigates the cost–quality trade-offs involved when coding agents switch between low‑cost, low‑capability (LC) and high‑cost, high‑capability (HC) language models during long‑running tasks. By experimenting with different handoff directions, timings, and interfaces—full‑trajectory transfer, compaction, and trajectory removal—the authors find that full‑trajectory escalation recovers less than half of the LC‑to‑HC quality gap while adding significant cost, a penalty they call the handoff tax. Conversely, downshifting from HC to LC yields a more favorable cost‑quality balance, and the optimal interface depends on the direction of the handoff. whyItMatters":"The study quantifies how model handoffs impact both performance and expense, offering guidance for designing more efficient coding agents that balance cost and quality."

arXiv Machine Learning
Jun 11

Claw-SWE-Bench: A Benchmark for Evaluating OpenClaw-style Agent Harnesses on Coding Tasks

arXiv:2606. 12344v1 Announce Type: new Abstract: General-purpose agents such as OpenClaw are increasingly used as autonomous tool users, but their coding ability is difficult to measure under SWE-bench: a generic agent does not by itself satisfy the clean Docker workspace, patch, and prediction contract required for scoring.

By Mengyu Zheng, Kai Han, Boxun Li, Haiyang Xu, Yuchuan Tian, Wei He, Hang Zhou, Jianyuan Guo, Hailin Hu, Lin Ma, Chao Xu, Guohao Dai, Lixue Xia, Yunchao Wei, Yunhe Wang, Yu Wang
arXiv AI
6d ago

LiteSearch-VL: Small Multimodal Search Agents via Trajectory Distillation and Synthetic Step-DPO

LiteSearch‑VL demonstrates that distilling released agent trajectories into small vision‑language backbones can transfer the agent’s behavioral contract, enabling a 2B model to produce usable answers in 28.4% of cases on multimodal benchmarks. The approach uses parameter‑efficient LoRA adapters and synthetic step‑level preferences derived from GPT‑5 hard negatives to refine tool use and query quality. While synthetic preference learning and tool distillation provide incremental improvements, the main bottleneck identified is answer verification rather than search depth.

By Saeed Khaki, Nima Safaei, Kamal Ginotra
arXiv Machine Learning
Jul 30

Scores Are Not Decisions: Cost-Aware Stopping for Tool Acquisition in LLM Agents

arXiv:2607. 27083v1 Announce Type: new Abstract: As LLM agents increasingly depend on diverse external services such as search engines, databases, and connectors, agent harnesses face a fundamental tool-selection challenge: acquiring too few tools leaves the task under-informed, while too many adds cost, context load, and privacy exposure.

By Yicheng Feng, Yan Zhang, Yan Cheng, Wei Qi