arXiv AI By Sima Noorani, Shayan Kiyani, George Pappas, Hamed Hassani

Disagreement-Guided Weak-to-Strong Routing

Read the original on arXiv AI →

The paper proposes a new weak-to-strong routing strategy that uses model disagreement—measured directly from model-generated responses—to decide when to forward a query to a stronger model, eliminating the need for costly ground‑truth supervision. By characterizing the optimal routing policy and deriving a principled approximation based on disagreement, the authors show that their method balances routing cost and response accuracy across both agentic and single‑turn tasks. Experiments demonstrate that disagreement‑guided routing performs competitively, and can even surpass methods trained to predict correctness when such signals are available.

Machine-generated by The Flow from the publisher's headline and feed description — not written or checked by a human. The full article lives at arXiv AI.

arXiv Computation and Language
5d ago

AgentCollab: A Self-Evaluation-Driven Collaboration Paradigm for Efficient LLM Agents

AgentCollab introduces a self-evaluation-driven collaboration paradigm for large language model agents, dynamically coordinating models of varying reasoning capacities during task execution. By using the agent’s own self-reflection to decide when to elevate to a stronger model, it avoids reliance on external routing modules and allocates additional reasoning budget only when recent failures indicate difficulty. Experiments on multi-step agent benchmarks demonstrate that this two-level small-large model setup consistently improves the accuracy-efficiency Pareto frontier of LLM agents.

By Wenbo Gao, Renxi Liu, Xian Wang, Fang Guo, Shuai Yang, Xi Chen, Hui-Ling Zhen, Hanting Chen, Weizhe Lin, Xiaosong Li, Yaoyuan Wang
arXiv Machine Learning
Aug 27

$R^3$: Training Robots to Reason in Natural Language via Reinforcement Learning

The paper introduces $R^3$, a post‑training method that converts vision‑language models into robotic reasoners by first mid‑training on expert reasoning traces and then refining them with single‑step rubric‑based reinforcement learning. $R^3$ enables free‑form language reasoning to guide low‑level manipulation policies, improving exploration, generalization, and performance on long‑horizon tasks in Language Table and simulated bimanual grocery packing benchmarks. The approach outperforms instruction‑only imitation learning baselines and demonstrates that natural language reasoning can serve as a test‑time compute mechanism for steering robotic actions.

By Lehong Wu, Yuxiao Qu, Zheyuan Hu, Ivan Zhang, Limin Wei, Zackory Erickson, Aviral Kumar
arXiv AI
Jul 14

Agentic Routing: The Harness-Native Data Flywheel

arXiv:2607. 11399v1 Announce Type: cross Abstract: Large language model agents are increasingly executed not by a single model call, but by an execution harness that manages observation, context, control, action, state, and verification.

By Xinchen Liu, Hang Zhou, Yingjie Zong, Yuchuan Tian, Liuyang Song, Shuo Zhang, Yulong Li, Wei He, Mengyu Zheng, Runke Liu, Siyang Cheng, Xiang Kuang, Hailin Hu, Kai Han, Yunhe Wang