CopRoute: Dependence-Aware Conformal Routing for Language Models

CopRoute introduces a dependence-aware conformal routing method for language models that orders models by the number of new queries each correctly answers beyond those already covered, selecting the minimal cutoff that satisfies a target all‑miss risk. This approach accounts for model failure dependencies—such as shared training data or architecture—that traditional risk‑controlled policies ignore. Experiments on RouterBench and RouterEval show CopRoute achieves fewer certified inference calls than state‑of‑the‑art methods, reducing calls by up to 79 % in some cases while maintaining the same risk level.

Machine-generated by The Flow from the publisher's headline and feed description — not written or checked by a human. The full article lives at arXiv Machine Learning.

• llms
• benchmarks