arXiv Computation and Language

Misinformation Propagation in Benign Multi-Agent Systems

arXiv AI
3d ago

Believed but Not Said: Measuring Hidden Belief Collapse in Multi-Agent LLM Discussions

The study examines how groups of large language model (LLM) agents handle misinformation when a few adversarial agents inject false claims into a discussion. In experiments with ten agents across six models and three datasets, a single adversarial agent caused 44.8% of benign agents to adopt the false answer, while three adversaries raised this to 60.5%. Interestingly, many benign agents privately held the false answer yet publicly disagreed, indicating hidden belief collapse that is not visible in the discussion itself.

By Liangjie Huang, Henry Peng Zou, Wei-Chieh Huang, Wooseong Yang, Yuwei Han, Philip S. Yu
Hugging Face Trending Papers
Aug 12

Learning to Persuade Exposes How Easily LLMs Abandon Correct Beliefs

Persuasion is a core dynamic of natural language communication, shaping how large language models (LLMs) update beliefs, resolve disagreements, and reach decisions. As LLMs increasingly debate, advise, and think collaboratively with humans and each other, resistance to harmful persuasion becomes a core requirement for reliable behavior.

arXiv Computation and Language
Aug 27

Reasoning or Rambling? Exploring the Effect of Thinking on Agent Persuasion

The paper investigates how explicit reasoning in Large Reasoning Models (LRMs) affects their ability to persuade and be persuaded. Experiments on objective and subjective tasks reveal a Persuasion Duality: reasoning boosts an agent’s persuasive power by about 21 percentage points while also making it less susceptible to incorrect persuasion by up to 10 percentage points. However, the study finds that persuasiveness often relies on superficial cues like response length and repetition rather than logical validity, and that persuasion can amplify or attenuate non‑linearly across multi‑hop agent chains. The authors also propose an attention‑guided prompt‑level adversarial argument detection method that improves agent robustness.

By Haodong Zhao, Jidong Li, Zhaomin Wu, Tianjie Ju, Zhuosheng Zhang, Bingsheng He, Gongshen Liu
arXiv AI
Oct 1

MADBench: Benchmarking the Security of Multi-Agent Debate

MADBench is a benchmark that evaluates the security of Multi-Agent Debate (MAD) systems, which allow large language models to exchange and critique answers. The study categorizes attacks into a layered taxonomy aligned with the MAD workflow and tests six attack families across 356 source tasks and 3,958 test cases. Results indicate that while MAD can reduce answer accuracy attacks compared to single-agent baselines, it may amplify unauthorized reads or writes, and even with collusion among agents, the final answer changes from correct to wrong only 28.30% of the time.

By Yuwan Liu, Jiaming Zhang, Yue Huang, Sisi Duan
arXiv AI
Sep 1

QUACK: Questioning, Understanding, and Auditing Communicated Knowledge in Multimodal Social Deduction Agents

arXiv:2605.27068v2 Announce Type: replace-cross Abstract: Social deduction games have become a popular testbed for probing reasoning, deception, coordination, and belief modeling in Large Language Mo...

By Ye Yuan, Rui Song, Weien Li, Zeyu Li, Haochen Liu, Xiangyu Kong, Changjiang Han, Yonghan Yang, Zichen Zhao, Zixuan Dong, Fuyuan Lyu, Bowei He, Haolun Wu, Jikun Kang, Xue Liu
arXiv AI
Sep 4

Remember and Reweight: Enhancing Multi-Agent Debate with Experience Memory and Confidence Estimation

The paper introduces R$^2$-MAD, a framework that enhances multi-agent debate by giving agents an experience memory from past debates. It uses a debate-state-aware retrieval policy to adjust concept priors based on current consensus, and derives confidence weights from retrieved experiences to modulate peer influence. Experiments demonstrate consistent improvements over existing single-agent and MAD baselines.

By Xuanfa Jin, Zhijian Ma, Yongcheng Zeng, Xinyu Cui, Haifeng Zhang, Jun Wang
arXiv AI
Jun 30

Safety from Honesty in a Disinterested AI Predictor

arXiv:2606. 29657v1 Announce Type: new Abstract: As AI systems become more capable, training procedures that optimize for downstream outcomes risk introducing implicit agency: goal-directed behavior that designers never specified.

By Yoshua Bengio, Oliver Richardson, Tom\'a\v{s} Gaven\v{c}iak, Michael Cohen, Rory Svarc, Damiano Fornasiere, Gael Gendron, David Hyland, Aton Kamanda, Adam Oberman, Francis Rhys Ward, Anna Gaven\v{c}iak, Jacob Livingston Slosser, Vincent Mai, Iulian Serban, Joumana Ghosn