arXiv:2609.38324v1 Announce Type: cross
Abstract: Multi-agent systems of LLMs add discussion to majority voting and are therefore expected to be more capable. However, empirical reports conflict on w...
By Chand Sahil Mansuri, Xin Wang, Mengying Li, Bryan Acton, Rory Eckardt, Dhaval Patel, Sadamori Kojaku
arXiv:2608. 15303v1 Announce Type: new Abstract: Test-time compute can substantially improve Large Language Model (LLM) reasoning performance, yet how and when additional compute helps remains poorly understood.
By Bo Wen, Yuhao Chen, Erhan Bilal, Carla Agurto Rios, Chen Wang, Junchen Jiang
The paper introduces TalkMesh, a decentralized network of small language model agents that learn to communicate effectively during inference. Each agent proposes an answer, scores it with a confidence head, and the most confident agent broadcasts a hint; lower‑confidence agents revise their proposals if a new suggestion scores higher. This gossip‑based consensus, trained via group relative policy optimization, enables a mesh of three agents to match the accuracy of majority voting over 32 samples, and scales to larger meshes to significantly boost performance on benchmarks like GSM8K and MATH-500.
By Mehmet Kerem Turkcan
Beyond Answer Voting: Fine-Grained Correction of LLM Reasoning through Graph Alignment across Sampled Traces proposes DDRG, a framework that uses graph alignment to detect claim-level disagreements in reasoning traces and selectively corrects them with a verifier. DDRG builds source‑grounded claim graphs, sends localized conflicts to an answer‑blind verifier, and applies a focused repair only when the verifier supports the majority answer’s path. Experiments on five benchmarks show that zero‑shot DDRG improves macro‑average accuracy by 8.65–15.83 percentage points over direct answering and outperforms CoT, GoT, GoV, and SC on this metric.
arXiv:2610.17869v1 Announce Type: new
Abstract: Multi-agent Large Language Model (LLM) systems typically commit to a deliberation protocol before inference. A fixed protocol cannot allocate computati...
By Yuan Liu, Haoyue Peng, Fanliang Hu, Lei Huang, Wenli Cai
ECMR: Evidence-Aware Deliberation Control for Multi-Agent LLM Reasoning proposes a controller that dynamically manages deliberation steps in multi-agent LLM systems. The controller evaluates answer concentration, support diversity, contradictions, role behavior, verification history, and remaining budget to decide actions such as propose, challenge, verify, arbitrate, diversify, correct, or stop. In a held‑out evaluation on MedQA, CaseHOLD, and FinQA, ECMR‑Full improves pooled accuracy from 62.1% to 84.9%, lowers false‑consensus from 40.7% to 17.0%, and raises evidence‑support from 58.0% to 88.7%.
arXiv:2610.18606v1 Announce Type: new
Abstract: Large language models increasingly tackle tasks that require multi-step reasoning, where errors in intermediate claims can affect the final answer. Sel...
By Haotian Liu, Yingjian Chen, Xiaohang Xu, Lang Huang, Yusuke Iwasawa, Yutaka Matsuo, Irene Li
arXiv:2610.18240v1 Announce Type: new
Abstract: Multi-agent debate (MAD) aims to improve large language model reasoning by exposing agents to alternative solutions and enabling iterative revision. Ho...
By Dezheng Bao, Sihang Du, Renhong Huang, Zhizhang Yuan, Yifei Sun, Yang Yang
arXiv:2601. 05746v2 Announce Type: replace Abstract: Recent years have witnessed the rapid development of Large Language Model-based Multi-Agent Systems (MAS), which excel at collaborative decision-making and complex problem-solving.
By Zhenghao Li, Zhi Zheng, Wei Chen, Jielun Zhao, Yong Chen, Tong Xu, Enhong Chen
arXiv:2608. 10665v1 Announce Type: new Abstract: Multimodal large language models often generate reasoning chains containing subtle errors that lead to incorrect answers.
By Rohit Sinha, Kunal Tilaganji, Tanuja Ganu, Nagarajan Natarajan, Amit Sharma, Vineeth Balasubramanian
arXiv:2610.16117v2 Announce Type: new
Abstract: LLM-based multi-agent collaboration is increasingly used to solve complex tasks by dividing work among specialized agents and integrating complementary...
By Chen Huang, Yiyang Zhang, Yuhao Wu, Yang Deng, Wenxuan Zhang
arXiv:2604. 09679v2 Announce Type: replace-cross Abstract: Multi-Agent Debate (MAD) is a collaborative framework in which multiple agents iteratively refine solutions through the generation of reasoning and alternating critique cycles.
By Yiqing Liu, Hantao Yao, Wu Liu, Allen He, Yongdong Zhang