OpenAI Blog

An open-source spec for orchestration: Symphony

Read the original on OpenAI Blog →

Learn how Symphony, an open-source spec for Codex orchestration, turns issue trackers into always-on agent systems—boosting engineering output and reducing context switching.

Machine-generated by The Flow from the publisher's headline and feed description — not written or checked by a human. The full article lives at OpenAI Blog.

arXiv Computation and Language
Oct 12

Proactive Agentic Orchestration

The paper introduces POrchestra, a proactive agentic orchestration framework that lets sub‑agents request harness adjustments during execution, enhancing adaptability to dynamic environments. It also proposes On‑Policy Orchestration Distillation (OPOD), which uses hindsight feedback from sub‑agents’ requests to provide targeted improvement signals for training the orchestration policy. Experiments on three long‑horizon benchmarks show that POrchestra boosts task success by about 9.1% over the best baseline, and with OPOD the improvement rises to 10.0%, while also improving cost‑performance trade‑offs.

By Xueyang Feng, Chaozhuo Li, Xiaohe Bo, Jiakai Tang, Chenxi Li, Qiwei Ye, Xu Chen
arXiv Computation and Language
Sep 1

SwarmBench: Can Large Language Models Act as Agent Swarm Orchestrators?

SwarmBench is a new benchmark designed to evaluate large language models (LLMs) as orchestrators of agent swarms, assessing accuracy, efficiency, cost, and process quality. The study finds significant variations in orchestration performance among current models, affecting not only final outcomes but also the quality of the orchestration process itself. To address these gaps, the authors introduce SwarmExp, a method that uses experience extraction and replay to consistently enhance LLM orchestration performance.

By Jinshan Gao, Zhuoran Jin, Tianyi Men, Kang Liu, Jun Zhao
arXiv AI
Oct 2

Understanding Issues, Causes and Solutions in Open-Source LLM-based Multi-Agent Systems

The paper investigates challenges in open‑source large‑language‑model (LLM) based multi‑agent systems (MAS). By analyzing 944 issues extracted from 21 projects, it finds that orchestration and execution problems are most common, with workflow, tool integration, and memory issues as primary causes. The predominant remedy identified is optimizing workflow, and the study offers empirically grounded implications for improving orchestration, tool integration, and memory mechanisms in LLM‑based MAS.

By Asad Ur Rehman, Syed Mohammad Kashif, Ruiyin Li, Peng Liang, Zengyang Li, Arif Ali Khan