arXiv Machine Learning By Kaixuan Liu, Guojun Xiong

Learning Multi-Agent Orchestration:Higher-Order Interactions in Policy Improvement

Read the original on arXiv Machine Learning →

The paper introduces IAPO, an interaction‑aware policy optimization framework for multi‑agent orchestration in large language model systems. IAPO decomposes the performance difference between policies into individual decision effects and their interactions, proving that interactions can account for up to half of the attainable gain. Experiments on long‑input tasks such as GSM8K, MATH, DROP, MBPP, and HumanEval show that IAPO’s plans achieve the highest accuracy among 15 published systems while using fewer tokens, and that omitting the interaction term reduces accuracy by 7–17 points on code tasks.

Machine-generated by The Flow from the publisher's headline and feed description — not written or checked by a human. The full article lives at arXiv Machine Learning.

arXiv Computation and Language
Oct 12

Proactive Agentic Orchestration

The paper introduces POrchestra, a proactive agentic orchestration framework that lets sub‑agents request harness adjustments during execution, enhancing adaptability to dynamic environments. It also proposes On‑Policy Orchestration Distillation (OPOD), which uses hindsight feedback from sub‑agents’ requests to provide targeted improvement signals for training the orchestration policy. Experiments on three long‑horizon benchmarks show that POrchestra boosts task success by about 9.1% over the best baseline, and with OPOD the improvement rises to 10.0%, while also improving cost‑performance trade‑offs.

By Xueyang Feng, Chaozhuo Li, Xiaohe Bo, Jiakai Tang, Chenxi Li, Qiwei Ye, Xu Chen
Hugging Face Trending Papers
Jun 19

Training the Orchestrator: A Supervised Approach to End-to-End PDDL Planning with LLM Agents

Translating natural-language planning intent into verified plans is a longstanding challenge: people communicate goals in language, while classical planners require formal PDDL specifications. Recent agentic frameworks bridge this gap by orchestrating a pool of specialized repair agents inside a verifier-checked refinement loop, but the orchestrator at the centre is itself a prompted frontier LLM, paying a frontier-LLM API call at every refinement step.

arXiv Machine Learning
Aug 26

IAPO: Influence-Aware Policy Optimization for Credit Assignment in Multi-Turn Service Agents

The paper introduces Influence-Aware Policy Optimization (IAPO), a method that models multi‑turn agent rollouts as typed influence‑dependency graphs to better assign credit to actions based on how information and errors flow through user and tool interactions. IAPO transforms the structure of support and failure usage into routing weights that redistribute trajectory‑level advantage, enabling more effective learning from sparse final rewards. Experiments with Qwen3‑4B and Qwen3‑8B on three service‑agent benchmarks show that IAPO outperforms existing multi‑turn reinforcement learning baselines without harming function‑calling performance.

By Bo Ren, Yirong Mao, Yi Yang, Wenhui Que