arXiv AI
Jul 23

In-the-Flow Agentic System Optimization for Effective Planning and Tool Use

arXiv:2510. 05592v2 Announce Type: replace Abstract: Outcome-driven reinforcement learning has advanced reasoning in large language models (LLMs), but prevailing tool-augmented approaches train a single, monolithic policy that interleaves thoughts and tool calls under full context; this scales poorly with long horizons and diverse tools and generalizes weakly to new scenarios.

By Zhuofeng Li, Haoxiang Zhang, Seungju Han, Sheng Liu, Jianwen Xie, Yu Zhang, Yejin Choi, James Zou, Pan Lu
arXiv AI
Oct 2

Reducing Cognitive Overhead in Tool Use via Multi-Small-Agent Reinforcement Learning

The paper introduces MSARL, a Multi‑Small‑Agent Reinforcement Learning framework that separates reasoning from tool use. A single Reasoning Agent plans and decomposes tasks, while multiple specialized Tool Agents handle specific external tools, each trained with imitation learning and reinforcement learning using role‑specific rewards. Experiments on mathematical problem solving with code execution show that MSARL improves reasoning stability and final‑answer accuracy compared to single‑agent baselines, and the architecture generalizes to other tool‑use tasks.

By Dayu Wang, Yutong Liu, Jiaye Yang, Weikang Li, Jiahui Liang, Yang Li