arXiv AI By Yilin Zhang, Han Jiang, Cai Xu, Ying Liu, Wei Zhao

Calibration-Aware Uncertainty Cascades for Efficient Heterogeneous Model Collaboration

Read the original on arXiv AI →

The paper introduces Calibration-Aware Uncertainty Cascades (CAUC), a post‑hoc framework that calibrates each model’s confidence independently and uses these calibrated scores to decide when to accept an early prediction, invoke a stronger model, or combine outputs. CAUC establishes a common reliability scale across heterogeneous models, decoupling deployment policies from specific model pools or budgets. Experiments on six language benchmarks show a 1.9% relative accuracy gain over strong‑model‑only inference while cutting strong‑model calls by about 47%, and on image classification it maintains or improves performance while reducing GFLOPs by up to 57%.

Machine-generated by The Flow from the publisher's headline and feed description — not written or checked by a human. The full article lives at arXiv AI.

arXiv AI
Jul 24

Routing Without Training: Controllable-Ratio LLM Offloading via Reliability Gating

arXiv:2607. 20481v1 Announce Type: new Abstract: Local-cloud collaboration is a practical way to deploy large language models under resource constraints, but existing methods often rely on trained routers or collaboration-aware finetuning that tie routing behavior to a particular operating regime.

By Evan Chen, Shiqiang Wang, Kevin S Chan, Su Wang, Christopher Brinton