arXiv Machine Learning
Measured Joules, Learned Routes: Learning to Route for Energy-Efficient LLM Serving
Read the original on arXiv Machine Learning →The Flow has not summarised this story yet — read it at arXiv Machine Learning.
Related stories
arXiv AI
Oct 27
EvoRouter: Cost-Efficient Multi-Agent Routing via Insight-Guided On-Policy Distillation
arXiv:2610.35690v1 Announce Type: new Abstract: Serving web queries at scale with multi-agent systems requires jointly configuring large language models, collaboration modes, agent counts, interactio...
arXiv Computation and Language
Oct 15
RouteWeaver: Weaving Mode Selection and Execution into Unified LLM Routing
arXiv:2610.19705v1 Announce Type: new Abstract: LLM routing dynamically selects and coordinates heterogeneous language models across diverse tasks. However, existing approaches are largely built arou...
arXiv Machine Learning
Jul 27
TRACE-ROUTER: Task-Consistent and Adaptive Online Routing for Agentic AI
arXiv:2607. 22465v1 Announce Type: cross Abstract: Routing to select large language models (LLMs) with different cost-quality trade-offs has become a fundamental deployment feature of enterprise AI.
arXiv Machine Learning
Aug 27
Ban&Pick: Enhancing Performance and Efficiency of MoE-LLMs via Smarter Routing
The paper introduces Ban&Pick, a post‑training, plug‑and‑play routing strategy for Sparse Mixture‑of‑Experts large language models. It identifies and reinforces a small group of highly influential experts while dynamically pruning redundant ones, leading to accuracy gains across math, code, and reasoning benchmarks. Experiments on DeepSeek and Qwen3 show notable performance improvements and a 1.25× inference speedup without retraining or architectural changes.
arXiv Computation and Language
Sep 1
Dynamic Model Routing and Cascading for Efficient LLM Inference: A Survey
arXiv:2603.04445v3 Announce Type: replace-cross Abstract: The rapid growth of large language models (LLMs) with diverse capabilities, costs, and domains has created a critical need for intelligent mo...
arXiv AI
Oct 7
Stepped MoE: Segment-Level Routing with Configurable Inference Complexity
arXiv:2610.07348v1 Announce Type: cross Abstract: Training large language models (LLMs) is resource-intensive, and adapting them for diverse deployment scenarios with varying computational constraint...