arXiv Machine Learning
Online Learning with LLM Experts from Limited Feedback
Read the original on arXiv Machine Learning →The Flow has not summarised this story yet — read it at arXiv Machine Learning.
Related stories
arXiv AI
Jul 28
WISERouter: LLM Routing with Workload Budget Constraint
arXiv:2607. 23765v1 Announce Type: cross Abstract: Large language models (LLMs) achieve impressive performance across multiple domains, but using the most capable model for every query is prohibitive at scale.
arXiv Machine Learning
Jun 30
Learning to Route and Schedule LLMs from User Retrials via Contextual Queueing Bandits
arXiv:2602. 02061v2 Announce Type: replace Abstract: Explosive demands for LLMs often cause user queries to accumulate in server queues, requiring efficient routing (query-LLM matching) and scheduling (query prioritization) mechanisms.
Hugging Face Trending Papers
Aug 17
Coverage-Maximizing Multinomial Subset Routing under Operational Constraints
We introduce Multinomial Subset Routing (MSR), a new online routing framework over $K$ experts in which the learner keeps a multinomial routing policy instead of a deterministic subset of experts. At each round, the learner samples $M$ experts i.
arXiv AI
Jun 16
Policy Regret for Embedding Model Routing: Contextual Bandits with Low-Rank Experts
arXiv:2606. 14929v1 Announce Type: cross Abstract: Modern recommendation systems increasingly rely on dynamically routing diverse queries to multiple embedding models.
arXiv AI
Jul 13
Correlation-Aware Contextual Bandits with Surrogate Rewards for LLM Routing
arXiv:2607. 09015v1 Announce Type: cross Abstract: We study contextual bandit problems with correlated arms and access to surrogate reward signals produced by a machine learning model, motivated by applications such as large language model (LLM) routing.
arXiv AI
Aug 18
Coverage-Maximizing Multinomial Subset Routing under Operational Constraints
arXiv:2608. 16375v1 Announce Type: cross Abstract: We introduce Multinomial Subset Routing (MSR), a new online routing framework over $K$ experts in which the learner keeps a multinomial routing policy instead of a deterministic subset of experts.