arXiv AI
Jun 15
Token-Level LLM Collaboration via FusionRoute
arXiv:2601. 05106v5 Announce Type: replace Abstract: Large language models (LLMs) exhibit strengths across diverse domains.
IR3DE: A Linear Router for Large Language Models
arXiv:2606. 06098v1 Announce Type: cross Abstract: Foundational Large Language Models (LLMs) demonstrate proficiency on a wide range of general tasks, and achieve remarkable results on various specialized tasks via domain-expert LLMs.
Related stories
arXiv AI
Jul 1
Learning to Select, Not Relearn: Hard-Routed Mixtures of Reasoning LoRAs
arXiv:2606. 31413v1 Announce Type: new Abstract: Composing independently trained LoRA adapters into a single large language model is useful for multi-domain adaptation, especially when the original training data cannot be shared.
arXiv Machine Learning
Jul 27
TRACE-ROUTER: Task-Consistent and Adaptive Online Routing for Agentic AI
arXiv:2607. 22465v1 Announce Type: cross Abstract: Routing to select large language models (LLMs) with different cost-quality trade-offs has become a fundamental deployment feature of enterprise AI.
arXiv Machine Learning
6d ago
LLM Router: Rethinking Routing with Prefill Activations
arXiv:2603. 20895v3 Announce Type: replace-cross Abstract: Existing routers rely on semantic query features or handcrafted features, which often fail to capture model-specific failures or intrinsic task difficulty.
arXiv Machine Learning
Aug 11
Routesplain: Towards Faithful and Intervenable Routing for Software-related Tasks
arXiv:2511. 09373v2 Announce Type: replace-cross Abstract: LLMs now tackle a wide range of software-related tasks, yet we show that their performance varies markedly both across and within these tasks.
arXiv AI
Jun 29
Agent-as-a-Router: Agentic Model Routing for Coding Tasks
arXiv:2606. 22902v3 Announce Type: replace Abstract: Real-world users typically have access to multiple Large Language Models (LLMs) from different providers, and these LLMs often excel at distinct domains, yet none dominate all.
arXiv AI
Jul 2
Predicting LLM Reasoning Performance with Small Proxy Model
arXiv:2509. 21013v4 Announce Type: replace-cross Abstract: Given the prohibitive cost of pre-training large language models, it is essential to leverage smaller proxy models to optimize datasets before scaling up.
arXiv AI
Jun 4
Adaptive Minds: Empowering Agents with LoRA-as-Tools
arXiv:2510. 15416v2 Announce Type: replace Abstract: We investigate a framework in which LoRA adapters are treated as callable tools that a base language model can dynamically select and invoke.
arXiv AI
Aug 12
LLMs Encode Their Failures: Predicting Success from Pre-Generation Activations
arXiv:2602. 09924v4 Announce Type: replace-cross Abstract: Running LLMs with extended reasoning on every problem is expensive, but determining which inputs actually require additional compute remains challenging.
arXiv AI
Aug 7
MACRO: Markov Chain Routing of Transformer Layers
arXiv:2608. 05872v1 Announce Type: cross Abstract: Standard Large Language Models (LLMs) execute layers sequentially.
arXiv AI
Aug 7
A note on conditional PAC-efficient reasoning in large language model routing
arXiv:2512. 03057v2 Announce Type: replace-cross Abstract: We study distribution-free risk control for model routing, motivated by large language model reasoning.
arXiv AI
Jul 2
SWE-Router: Routing in Multi-turn Agentic Software Engineering Tasks
arXiv:2607. 00053v1 Announce Type: cross Abstract: Large language models (LLMs) embedded in multi-turn agentic harnesses are reshaping software engineering (SWE), but routing every task to a frontier model is wasteful when many issues admit cheap fixes.