Hugging Face Trending Papers
Whose turn is it? Context-guided model routing for stateful agents
Read the original on Hugging Face Trending Papers →The Flow has not summarised this story yet — read it at Hugging Face Trending Papers.
Related stories
arXiv AI
Oct 15
TurnCost: Turns, Not Observations: Cache-Aware Loop Engineering for Coding Agents
arXiv:2610.15093v1 Announce Type: cross Abstract: AI coding agents operate in iterative loops: they modify code, run tools, inspect the results, and decide what to do next. We call the design of this...
arXiv AI
Aug 17
Not All Tokens Are Equal: Inflation-Aware Routing for Agentic LLM Systems
arXiv:2608. 13571v1 Announce Type: cross Abstract: When a language model fails to answer a query on the first attempt, an agentic system retries, consuming additional tokens each time.
Hugging Face Trending Papers
Jun 8
AGENTSERVESIM: A Hardware-aware Simulator for Multi-Turn LLM Agent Serving
Multi-turn LLM agents interleave model calls with external tool invocations, shifting serving from stateless request processing to stateful program execution. Serving these workloads requires scheduling, KV-cache management, and routing policies that use program-level context, including turn dependencies, tool-induced gaps, and reusable KV state.
arXiv Computation and Language
Aug 27
Routed Graph Handoff: Adaptive Format Selection for Multi-Agent LLM Delegation
The paper introduces Routed Graph Handoff, a lightweight LLM router that chooses between a typed dependency graph and natural language for each delegation in multi‑agent LLM systems. On four benchmarks with over 1,050 trajectories, the routed system matches or surpasses natural‑language‑only performance, achieving significant compression and accuracy gains. The approach requires a graph‑aware executor prompt, and an oracle analysis suggests further potential for execution‑time adaptive routing.
arXiv AI
Sep 30
TwinRouterBench: Fast Static and Live Dynamic Evaluation for Realistic Agentic LLM Routing
arXiv:2605.18859v3 Announce Type: replace-cross Abstract: LLM routing matters most in long-horizon applications such as coding agents, deep research systems, and computer-use agents, where a single u...
arXiv AI
Aug 18
Task- and Session-Level Model Routing: A Common-Interface Hybrid Evaluation of Four Open-Source Routers Across Four Benchmarks
arXiv:2608. 14641v1 Announce Type: new Abstract: Agentic systems increasingly delegate model selection to a router, yet open-source routers are usually evaluated with different tasks, candidate pools, and execution protocols, limiting direct comparison.