arXiv Computation and Language
Misinformation Propagation in Benign Multi-Agent Systems
Read the original on arXiv Computation and Language →The Flow has not summarised this story yet — read it at arXiv Computation and Language.
Related stories
arXiv AI
3d ago
Believed but Not Said: Measuring Hidden Belief Collapse in Multi-Agent LLM Discussions
The study examines how groups of large language model (LLM) agents handle misinformation when a few adversarial agents inject false claims into a discussion. In experiments with ten agents across six models and three datasets, a single adversarial agent caused 44.8% of benign agents to adopt the false answer, while three adversaries raised this to 60.5%. Interestingly, many benign agents privately held the false answer yet publicly disagreed, indicating hidden belief collapse that is not visible in the discussion itself.
Hugging Face Trending Papers
Aug 12
Learning to Persuade Exposes How Easily LLMs Abandon Correct Beliefs
Persuasion is a core dynamic of natural language communication, shaping how large language models (LLMs) update beliefs, resolve disagreements, and reach decisions. As LLMs increasingly debate, advise, and think collaboratively with humans and each other, resistance to harmful persuasion becomes a core requirement for reliable behavior.
arXiv AI
Aug 13
Learning to Persuade Exposes How Easily LLMs Abandon Correct Beliefs
arXiv:2608. 11624v1 Announce Type: cross Abstract: Persuasion is a core dynamic of natural language communication, shaping how large language models (LLMs) update beliefs, resolve disagreements, and reach decisions.
arXiv Computation and Language
Aug 27
Reasoning or Rambling? Exploring the Effect of Thinking on Agent Persuasion
The paper investigates how explicit reasoning in Large Reasoning Models (LRMs) affects their ability to persuade and be persuaded. Experiments on objective and subjective tasks reveal a Persuasion Duality: reasoning boosts an agent’s persuasive power by about 21 percentage points while also making it less susceptible to incorrect persuasion by up to 10 percentage points. However, the study finds that persuasiveness often relies on superficial cues like response length and repetition rather than logical validity, and that persuasion can amplify or attenuate non‑linearly across multi‑hop agent chains. The authors also propose an attention‑guided prompt‑level adversarial argument detection method that improves agent robustness.
arXiv AI
Oct 1
MADBench: Benchmarking the Security of Multi-Agent Debate
MADBench is a benchmark that evaluates the security of Multi-Agent Debate (MAD) systems, which allow large language models to exchange and critique answers. The study categorizes attacks into a layered taxonomy aligned with the MAD workflow and tests six attack families across 356 source tasks and 3,958 test cases. Results indicate that while MAD can reduce answer accuracy attacks compared to single-agent baselines, it may amplify unauthorized reads or writes, and even with collusion among agents, the final answer changes from correct to wrong only 28.30% of the time.
arXiv AI
Jun 2
Easier to Mislead Than to Correct: Harmful and Beneficial Revision in LLM Conformity
arXiv:2606. 01637v1 Announce Type: cross Abstract: Large language models are increasingly used in multi-agent systems, where they see and respond to other agents' answers.