← Back to all news
arXiv AI By Zilin Wang, Yinhong Liu, Chao Chen, Qun Liu, Zhijiang Guo

Trajectory-Level Speculation with Semantic Verification for Tool-Using Agents

Read the original on arXiv AI →

The paper introduces SpecAgent, a protocol that lets a strong language model act as a reviewer rather than a generator for tool‑using agents. A weaker model drafts steps, executing read‑only tool calls to ground its proposals, while the strong model verifies the draft in a single prefill pass, committing the longest valid prefix and repairing any rejected step. Experiments on benchmarks show SpecAgent achieves near‑strong‑model performance while cutting memory traffic, wall time, and token generation.

Machine-generated by The Flow from the publisher's headline and feed description — not written or checked by a human. The full article lives at arXiv AI.

Related stories

arXiv AI
Jul 24

DynamicMCPBench: A Trace-Grounded, Effect-Scored Benchmark for LLM Agents over Live MCP Servers

arXiv:2607. 20531v1 Announce Type: new Abstract: Large language model (LLM) agents are increasingly deployed over Model Context Protocol (MCP) servers, yet the benchmarks used to evaluate them score the final answer or a fixed "ground-truth" list of tools, both of which are fragile once the underlying data is live and stateful.

By Jerzy Kami\'nski, Ilya Galyukshev, Artem Kuznetsov, Sergey Chuprin, Kirill Redko, Aidar Shumbalov, Anna Kalyuzhnaya
llmsagentsbenchmarks
More like this →
arXiv AI
Sep 4

Speculative Macro Commit for Faster Tool-Using Agents

Speculative Macro Commit (SMC) is a runtime technique for tool‑using language‑model agents that separates an authoritative actor model from a faster speculative drafter model. The drafter predicts and executes future action chains on a snapshot, storing recurring multi‑action patterns in a macro library. When the actor’s next tool call aligns with a drafted action, SMC commits the pre‑executed steps, reducing latency by up to 18.59% on certain benchmarks while maintaining accuracy.

By Zeyu Liu, Souvik Kundu, Peter A. Beerel
llmsagents
More like this →
arXiv AI
Oct 7

Do I Need the Cloud? Uncertainty-Aware Step-Level Handoff for Small Language Model Agents

The paper introduces STEPGATE, an uncertainty‑aware handoff framework that evaluates each step of a small language model (SLM) agent and selectively escalates difficult steps to a stronger model. On a 52‑task single‑step benchmark, the Qwen2.5‑1.5B/7B pair achieved 82.7% task success with only 30.8% escalation, outperforming local‑only and random escalation baselines. In multi‑turn tests, STEPGATE reached 69.0% trajectory success and 84.0% action success while using only 30.0% cloud actions, demonstrating that step‑level escalation can close much of the performance gap to a stronger backend with fewer remote tokens.

By Abolfazl Younesi
llmsagentssafety
More like this →