arXiv Machine Learning By Guannan Lai, Haoran Hu, Long Chen, Zhenguo Li, Han-Jia Ye

From Sampled Outcomes to Capability Distributions: Rethinking Supervision for LLM Routing

Read the original on arXiv Machine Learning →

arXiv:2606. 06924v1 Announce Type: new Abstract: Existing LLM routing methods typically treat a model's single response to a query as its capability label for training routers.

Summary generated by The Flow from the publisher's feed. The full article lives at arXiv Machine Learning.

arXiv AI
Jul 24

Routing Without Training: Controllable-Ratio LLM Offloading via Reliability Gating

arXiv:2607. 20481v1 Announce Type: new Abstract: Local-cloud collaboration is a practical way to deploy large language models under resource constraints, but existing methods often rely on trained routers or collaboration-aware finetuning that tie routing behavior to a particular operating regime.

By Evan Chen, Shiqiang Wang, Kevin S Chan, Su Wang, Christopher Brinton
arXiv Machine Learning
6d ago

LLM Router: Rethinking Routing with Prefill Activations

arXiv:2603. 20895v3 Announce Type: replace-cross Abstract: Existing routers rely on semantic query features or handcrafted features, which often fail to capture model-specific failures or intrinsic task difficulty.

By Tanay Varshney, Annie Surla, Michelle Xu, Gomathy Venkata Krishnan, Maximilian Jeblick, David Austin, Neal Vaidya, Davide Onofrio