The paper investigates whether complex communication topologies are necessary for effective multi‑agent debate (MAD) among large language models. It demonstrates that a simple random-without-replacement routing policy—where each agent debates with two newly sampled peers each round—consistently improves the accuracy‑cost trade‑off in sparse MAD setups. Additionally, the study shows that lightweight deliberation stopping can further reduce inference costs without sacrificing accuracy.
By Boxuan Wang, Zhuoyun Li, Xiaowei Huang, Yi Dong
arXiv:2606.20621v2 Announce Type: replace
Abstract: Multi-agent debate improves the reliability of large language models (LLMs) through iterative peer critiques. However, fixed topologies often intro...
By Yang Feng, Ziwei Xu, Xia Hu, Fengxiang He
arXiv:2606. 29425v1 Announce Type: new Abstract: Existing multi-agent debate frameworks suffer from two critical limitations: they rely on static architectures where agent roles and coordination patterns are fixed at design time, and they require instantiating multiple model copies, incurring substantial computational overhead.
By Dayong Liang, Kaisong Gong, Yi Cai, Changmeng Zheng, Xiao-Yong Wei
arXiv:2510. 20963v2 Announce Type: replace Abstract: Multi-agent debate (MAD) was proposed as a promising approach for ensembling the wisdom of multiple large language models (LLMs) to improve reasoning and provide effective supervision to superhuman LLMs.
By Yongqiang Chen, Gang Niu, James Cheng, Bo Han, Masashi Sugiyama
Large language model-driven multi-agent systems enhance the reliability of complex reasoning tasks through multi-round deliberation, role specialization, and cross-validation. However, existing multi-agent debate and collaboration frameworks typically adopt fully connected communication, causing the number of messages, token costs, and end-to-end latency to grow approximately quadratically with the number of agents; although fixed sparse topologies reduce overhead, they cannot adapt communication relationships to different task instances or intermediate reasoning states, making them prone either to preserving low-value interactions or to losing critical error-correction information.
arXiv:2606. 01828v1 Announce Type: cross Abstract: Large language model-driven multi-agent systems enhance the reliability of complex reasoning tasks through multi-round deliberation, role specialization, and cross-validation.
By Wanshuang Gou, Zihan Liu