arXiv AI By Harry Yizhou Tian, Ming Yin

Understanding the Effects of Multi-Agent Deliberation for Human-AI Decision-Making

Read the original on arXiv AI →

The paper investigates whether multi-agent deliberation (MAD)—where several large language models (LLMs) engage in structured, multi-round discussion—helps humans make better decisions. Two user studies compare MAD to single-round AI assistance and examine the impact of adding a second AI and of multi-round interaction, finding that repeated interaction is the main driver of improved performance. The authors also explore design choices such as AI persona and human engagement level, noting that a devil’s advocate persona reduces accuracy and experience, while active human participation can boost accuracy at the cost of frustration.

Machine-generated by The Flow from the publisher's headline and feed description — not written or checked by a human. The full article lives at arXiv AI.

arXiv AI
2d ago

Scaling public input on AI policy with pluralistic agents

The paper introduces pluralistic agents—AI representatives that deliberate on behalf of individuals—to scale public input on AI policy. Experiments with 746 participants show that these agents can reliably shift policies toward their represented personas’ preferences and are viewed as useful and fair, outperforming a single AI reasoning model. The study highlights how agent influence varies with instructions and design, suggesting a cautious but promising role for pluralistic agents in expanding human participation in AI safety policy development.

By Jacy Reese Anthis, Ken Burke, David Madras, Crystal Qian, Meredith Ringel Morris, Logan Cross, Caroline Pantofaru, Utsav Prabhu
arXiv AI
Oct 21

Humans Correct Their Judgments Through Debate, but Weaker AI Models Do Not

The paper examines whether AI‑driven debate can help humans and weaker language models (LLMs) correct their judgments. Experiments show that debate improves human accuracy over prior beliefs, especially with weighted voting, but offers little benefit—and sometimes harms—accuracy for weaker LLM supervisors. The study highlights debate as a promising tool for scalable human oversight while questioning its effectiveness for fully automated AI control.

By Maria Victoria Carro, Denise Alejandra Mester, Facundo Nieto, Oscar Agustin Stanchi, Guido Ernesto Bergman, Giovanni Franco Gabriel Marrafini, Trinidad Borrell, Guido Freire, Joaquin Salvador Machulsky, Mario Alejandro Leiva, Ana Lopez, Nicolas Spinelli, Luca Nicolas Forziati Gangi, Eitan Sprejer, Federico Barrera Lemarchand, Gerardo Simari, Maria Vanina Martinez
arXiv AI
Aug 3

M3MAD-Bench: Multi-Dimensional Evaluation of Multi-Agent Debate Across Domains and Modalities

arXiv:2601. 02854v2 Announce Type: replace Abstract: As an agent-level reasoning and coordination paradigm, Multi-Agent Debate (MAD) orchestrates multiple agents through structured debate to improve answer quality and support complex reasoning.

By Ao Li, Jinghui Zhang, Luyu Li, Yuxiang Duan, Lang Gao, Mingcai Chen, Weijun Qin, Shaopeng Li, Fengxian Ji, Ning Liu, Lizhen Cui, Xiuying Chen, Yuntao Du
arXiv AI
Sep 18

AI Should Facilitate Democratic Deliberation at Scale

The paper argues that AI can strengthen democracy by supporting large‑scale deliberation, addressing cognitive, social, platform‑design, and market frictions while preserving human agency. It contrasts AI‑assisted deliberation with liquid democracy, claiming the former lowers barriers to meaningful engagement without replacing human judgment. The authors outline four guiding principles—preserving agency, encouraging mutual respect, promoting equality, and augmenting active citizenship—and discuss challenges such as alignment, sycophancy, bias, and over‑reliance. They call on the machine learning community to develop and evaluate deliberation‑focused AI systems based on their ability to facilitate informed, representative, and friction‑robust discourse.

By Jos\'e Ram\'on Enr\'iquez, Jiaxin Pei, Alex Pentland
arXiv AI
Jun 2

Demystifying Multi-Agent Debate: The Role of Confidence and Diversity

arXiv:2601. 19921v2 Announce Type: replace-cross Abstract: Multi-agent debate (MAD) is widely used to improve large language model (LLM) performance through test-time scaling, yet recent work shows that vanilla MAD often underperforms simple majority vote despite higher computational cost.

By Xiaochen Zhu, Caiqi Zhang, Yizhou Chi, Tom Stafford, Nigel Collier, Andreas Vlachos