arXiv AI

Capability Is Not Propensity: Measuring Pressure-Robust Cooperative Behavior in Civic LLM Agents

arXiv:2608. 09485v1 Announce Type: new Abstract: Cooperative capabilities in language models are dual-use.

arXiv AI
Oct 5

Peer Influence across Heterogeneous AI Models

The study investigates how AI agents influence each other when they disagree, measuring persuasion as the change in an agent’s decision after a single exchange. Across seven open‑weight models and three language tasks, it finds that persuasion is strong—receivers often abandon their initial judgment after seeing a peer’s answer and explanation. Surprisingly, neither certainty nor model size reliably predicts persuasion dynamics; small models can persuade and resist larger ones just as effectively, and the shift depends more on the listener’s susceptibility than the speaker’s persuasiveness.

By Frida N{\o}hr Laustsen, Marie Haahr Petersen, Victoria Popa, Ariel Flint, Romualdo Pastor-Satorras, Andrea Baronchelli, Luca Maria Aiello
arXiv Computation and Language
2d ago

Phantom Consensus: Measuring Social Reasoning in Multi-Agent LLM Decision-Making

The paper introduces the concept of phantom consensus, where large language models (LLMs) alter their public decisions after seeing ambiguous social signals and misreport the private judgments of other agents, even when the recorded private judgments support a different consensus. To investigate this, the authors create PHANTOM-Bench, a benchmark that isolates private judgments, public decisions, and estimates of group beliefs, and tests models under various conditions. Experiments across nine LLMs show that ambiguous signals can significantly degrade decision quality, with public accuracy dropping up to 47.8 percentage points and collective rationality failures reaching 47.3% in the most vulnerable settings, while revealing private decisions can mitigate many failures.

By Disha Sheshanarayana, Rajat Subhra Pal, Manjira Sinha, Tirthankar Dasgupta
Hugging Face Trending Papers
Oct 13

ECMR: Evidence-Aware Deliberation Control for Multi-Agent LLM Reasoning

ECMR: Evidence-Aware Deliberation Control for Multi-Agent LLM Reasoning proposes a controller that dynamically manages deliberation steps in multi-agent LLM systems. The controller evaluates answer concentration, support diversity, contradictions, role behavior, verification history, and remaining budget to decide actions such as propose, challenge, verify, arbitrate, diversify, correct, or stop. In a held‑out evaluation on MedQA, CaseHOLD, and FinQA, ECMR‑Full improves pooled accuracy from 62.1% to 84.9%, lowers false‑consensus from 40.7% to 17.0%, and raises evidence‑support from 58.0% to 88.7%.

arXiv AI
Oct 28

Who Convinced Whom? Tracing How LLMs Change Their Minds in Multi-Agent Systems

The paper introduces MAD Bench, a 2,400-question benchmark for multi‑agent debate (MAD) that tests knowledge, reasoning, values, moral judgment, safety, and refusal. It evaluates three open‑weight models and finds that peer communication can alter individual decisions, with forced‑choice readouts before rationale generation more often matching the final answer in debate than in reflection. The study shows that stronger consensus can coexist with increased shared errors, suggesting the need for evaluation metrics that consider dependence and unanimous errors alongside accuracy.

By Arnesh Batra, Aniket Khandelwal, Jashn Khemani, Krish Thukral, Arush Gumber, Denis Federico Lim, Ujwal Kumar, Phan Xuan Tan
arXiv AI
Jun 2

Demystifying Multi-Agent Debate: The Role of Confidence and Diversity

arXiv:2601. 19921v2 Announce Type: replace-cross Abstract: Multi-agent debate (MAD) is widely used to improve large language model (LLM) performance through test-time scaling, yet recent work shows that vanilla MAD often underperforms simple majority vote despite higher computational cost.

By Xiaochen Zhu, Caiqi Zhang, Yizhou Chi, Tom Stafford, Nigel Collier, Andreas Vlachos
arXiv Computation and Language
Sep 3

AI agents reshape consensus formation in human groups

The study investigates how large language model (LLM) agents influence consensus formation in mixed human‑AI groups during a collaborative description game. Three regimes emerge: low agent proportions lead to human‑led consensus, intermediate proportions disrupt convergence, and high proportions produce strong, agent‑led consensus. The resulting consensus differs in semantic grounding and communicative form, with human‑led consensus being concrete and holistic, and agent‑led consensus being abstract and geometrically segmented.

By Lin Chen, Ziyi Liu, Xia Hu, Yong Li