arXiv AI
Handoff Curves: Initial Selection, Later Handoff, and Supervision Targets in Multi-turn LLM Routing
Read the original on arXiv AI →The Flow has not summarised this story yet — read it at arXiv AI.
Related stories
arXiv AI
Sep 30
TwinRouterBench: Fast Static and Live Dynamic Evaluation for Realistic Agentic LLM Routing
arXiv:2605.18859v3 Announce Type: replace-cross Abstract: LLM routing matters most in long-horizon applications such as coding agents, deep research systems, and computer-use agents, where a single u...
arXiv AI
Aug 6
Scrouting: Cost-Aware Routing of Coding Agents by Scouting the Repository First
arXiv:2608. 04804v1 Announce Type: cross Abstract: Frontier language models can resolve repository-level software issues, but each attempt is expensive, and existing routers select a model from the issue text alone.
arXiv Machine Learning
6d ago
Response-Informed Value Estimation for Cost-Aware Multi-Turn LLM Routing
The paper introduces RIVET, a method for multi‑turn large language model routing that uses post‑call responses to train two value estimators: a deployable Routing Value Estimator that operates on pre‑call information, and a training‑only Response‑Informed Value Estimator that also observes the actual response. By conditioning on the response, RIVET turns response‑induced return variation into an observable covariate, reducing asymptotic estimation error. Experiments on the MINT benchmark show that RIVET solves more held‑out tasks than the strongest baseline while cutting total call cost by 74.7%.
arXiv Machine Learning
Jul 30
Scores Are Not Decisions: Cost-Aware Stopping for Tool Acquisition in LLM Agents
arXiv:2607. 27083v1 Announce Type: new Abstract: As LLM agents increasingly depend on diverse external services such as search engines, databases, and connectors, agent harnesses face a fundamental tool-selection challenge: acquiring too few tools leaves the task under-informed, while too many adds cost, context load, and privacy exposure.
arXiv AI
Sep 30
Pretrain Once, Route Anywhere: Towards a Foundation Model for LLM Routing
arXiv:2609.37362v1 Announce Type: new Abstract: Large language model (LLM) routing aims to assign each query to the most suitable model from a heterogeneous candidate pool, improving the quality--eff...
arXiv Machine Learning
Jun 16
HyDRA: Hybrid Dynamic Routing Architecture for Heterogeneous LLM Pools
arXiv:2605. 17106v2 Announce Type: replace-cross Abstract: Production LLM deployments increasingly maintain heterogeneous model pools spanning order-of-magnitude cost differences.