arXiv Machine Learning By Hanshuai Cui, Zhiqing Tang, Zhi Yao, Jun Luo, Weijia Jia

RetryRoute: Retry-Aware Model Routing for Agentic Image Editing Services

Read the original on arXiv Machine Learning →

RetryRoute is a new routing framework for web agents that edit images by calling open editing models in a critique-and-retry loop. It addresses the problem that existing routers treat each retry as an independent draw, whereas empirical analysis shows that a retry after a failure succeeds only 17‑53% as often as a first try across six open models. By estimating each model’s chance of success given the request’s failure history, planning retries, escalations and abandonment, and incorporating live queue waits, RetryRoute improves success rates and delivery within service-level objectives compared to eleven prior baselines.

Machine-generated by The Flow from the publisher's headline and feed description — not written or checked by a human. The full article lives at arXiv Machine Learning.

arXiv Computation and Language
Oct 26

Cluster, Route, Escalate: Cascaded Framework for Cost-Aware LLM Serving

arXiv:2606.27457v2 Announce Type: replace-cross Abstract: Serving open-weight language models on premises forces a trade-off between accuracy and computational cost. Hosting models of different sizes...

By Yasmin Moslem, Magdalena Kacmajor, Vasudevan Nedumpozhimana, Ammar Abbas, Solmaz Panahi, David Lynch, Zhuangzhuang Nie, Alexandros Agapitos, Aleksandar Milenovic, Hongmeng Song, Yucheng Shi, Yue Pan, Patricia Buffini, John D. Kelleher
arXiv AI
Sep 30

TwinRouterBench: Fast Static and Live Dynamic Evaluation for Realistic Agentic LLM Routing

arXiv:2605.18859v3 Announce Type: replace-cross Abstract: LLM routing matters most in long-horizon applications such as coding agents, deep research systems, and computer-use agents, where a single u...

By Pei Yang, Wanyi Chen, Tongyun Yang, Pengbin Feng, Jiarong Xing, Wentao Guo, Yuhang Yao, Yuhang Han, Hanchen Li, Xu Wang, Zeyu Wang, Jie Xiao, Anjie Yang, Liang Tian, Lynn Ai, Eric Yang, Tianyu Shi