arXiv AI By Xavier Cadet, Junyan Cheng, Peter Chin, Kyle Richardson

Mining the Design Space of Multi-Agent Workflows

Read the original on arXiv AI →

The paper introduces a two‑phase pipeline that mines reproducible design principles for large language model multi‑agent systems by reusing all intermediate search trajectories from an MCTS optimizer. Using six composable operators and 26 Enigmata tasks, the authors generate a corpus of 28,568 executable workflows and apply an AutoResearch loop to discover and validate orchestration patterns. Key findings include that Star‑first workflows underperform, SharedMemory outperforms debate, and prompt specificity and placeholder‑based routing provide comparable gains to communication‑structure selection.

Machine-generated by The Flow from the publisher's headline and feed description — not written or checked by a human. The full article lives at arXiv AI.

arXiv AI
Oct 2

Pay for the Fault, Not the Flow: Label-Free In-Flow Multi-Agent Workflow Optimization

The paper introduces InFlowOp, a label‑free optimization framework that assigns costs to each decision in a multi‑agent workflow, balancing agent competence against execution time. It determines task granularity and agent assignment before execution and corrects faults during execution using the same cost metric. The authors also present Braid, a benchmark for multi‑agent coordination, and show that InFlowOp outperforms single‑agent baselines by up to 11.97% across various domains.

By Xuehang Guo, Haoyu Wang, Shengyu Chen, Zach Chen, Wei Cheng, Qingyun Wang, Haifeng Chen
arXiv AI
Oct 12

Do More Agents Help? Evaluating Accuracy and Cost in LLM Multi-Agent Workflows

The paper introduces BenchAgent, a framework for evaluating multi‑agent large language model (LLM) workflows against a single‑agent baseline, BenchAgent Core. Using GPT‑4.1 across ten reasoning, coding, and tool‑use benchmarks, the study compares six multi‑agent configurations, finding that EvoAgent achieves the highest mean pooled accuracy (79.70%) while other agents lag by 1.71–8.76 percentage points. The analysis also highlights trade‑offs in token consumption and accuracy, offering guidance for selecting and optimizing LLM multi‑agent workflows.

By Yuhang Fu, Ruishan Fang, Jiaqi Shao, Huiyu Zheng, Zhengtao Zhu, Bing Luo, Zhenyu Wen, Tao Lin
arXiv Computation and Language
2d ago

From Apparent Search Gains to Selection Failures: Auditing Test-Time Inference in Structured Workflow Planning

The paper investigates how different components of test-time inference—prompting, post-processing, and selection—affect performance in structured workflow planning on DisasterBench. By breaking inference into discovery, validation, and selection stages, the authors compare independent sampling, nominal tree-search, and multi-operator search across two model families. Their findings show that while tree-search and independent sampling achieve similar workflow discovery, structural validation rarely discards correct workflows, yet majority voting often fails to select them, revealing significant tool-choice or information-flow errors. A tool-specification-aware verifier can recover some losses but also overturns more correct decisions.

By Zhitong Chen, Weifeng Zhang, Kai Yin, Zhiyuan Wang, Ali Mostafavi, James Caverlee