arXiv Computation and Language By Jiayuan Liu, Shiyi Du, Weihua Du, Xinhao Cheng, Mingyu Guo, Vincent Conitzer

The Consensus Trap: Collaborative Interleaved Generation to Defend against a Corrupted Majority

Read the original on arXiv Computation and Language →

The paper identifies a "consensus trap" where majority voting among large language model agents can reinforce incorrect answers when the majority follows misleading instructions. It proposes chunk‑interleaved Round‑Robin (RR) collaboration, allowing agents to take turns extending a shared reasoning trajectory so that minority agents can insert corrections before the final answer is produced. Experiments across model families and reasoning benchmarks show that RR improves accuracy under majority corruption while maintaining performance under minority corruption, and that shared reasoning during turns tends to increase support for the correct answer.

Machine-generated by The Flow from the publisher's headline and feed description — not written or checked by a human. The full article lives at arXiv Computation and Language.

arXiv Machine Learning
Sep 29

Reinforcement Learning of Communication in a Mesh of Small Language Models

The paper introduces TalkMesh, a decentralized network of small language model agents that learn to communicate effectively during inference. Each agent proposes an answer, scores it with a confidence head, and the most confident agent broadcasts a hint; lower‑confidence agents revise their proposals if a new suggestion scores higher. This gossip‑based consensus, trained via group relative policy optimization, enables a mesh of three agents to match the accuracy of majority voting over 32 samples, and scales to larger meshes to significantly boost performance on benchmarks like GSM8K and MATH-500.

By Mehmet Kerem Turkcan
Hugging Face Trending Papers
Oct 13

Beyond Answer Voting: Fine-Grained Correction of LLM Reasoning through Graph Alignment across Sampled Traces

Beyond Answer Voting: Fine-Grained Correction of LLM Reasoning through Graph Alignment across Sampled Traces proposes DDRG, a framework that uses graph alignment to detect claim-level disagreements in reasoning traces and selectively corrects them with a verifier. DDRG builds source‑grounded claim graphs, sends localized conflicts to an answer‑blind verifier, and applies a focused repair only when the verifier supports the majority answer’s path. Experiments on five benchmarks show that zero‑shot DDRG improves macro‑average accuracy by 8.65–15.83 percentage points over direct answering and outperforms CoT, GoT, GoV, and SC on this metric.

Hugging Face Trending Papers
Oct 13

ECMR: Evidence-Aware Deliberation Control for Multi-Agent LLM Reasoning

ECMR: Evidence-Aware Deliberation Control for Multi-Agent LLM Reasoning proposes a controller that dynamically manages deliberation steps in multi-agent LLM systems. The controller evaluates answer concentration, support diversity, contradictions, role behavior, verification history, and remaining budget to decide actions such as propose, challenge, verify, arbitrate, diversify, correct, or stop. In a held‑out evaluation on MedQA, CaseHOLD, and FinQA, ECMR‑Full improves pooled accuracy from 62.1% to 84.9%, lowers false‑consensus from 40.7% to 17.0%, and raises evidence‑support from 58.0% to 88.7%.