arXiv Machine Learning
Homogenization in Multi-Agent Systems
Read the original on arXiv Machine Learning →The Flow has not summarised this story yet — read it at arXiv Machine Learning.
Related stories
arXiv AI
Oct 1
MiniRep: Robust Reputation-Based Aggregation for Multi-Agent Debate
MiniRep is a reputation‑based aggregation system designed for multi‑agent debate (MAD) that remains robust even when malicious agents are present. It evaluates agents on both their current task performance and historical reputation, while preventing groups of agents with highly similar responses from dominating the final decision. Experiments on the MATH benchmark show that MiniRep consistently outperforms conventional MAD aggregation and other reputation‑based approaches across a wide range of attack scenarios.
arXiv AI
Oct 12
X-AgentRed: Red-Teaming Personal Agents in Evolving Multi-Service Ecosystems
X-AgentRed is a self‑evolving red‑teaming framework designed to uncover harmful tool‑call paths in personal agents that interact with multiple web services. It builds a directed graph of tool dependencies by analyzing each tool’s effects, potential harms, and execution preconditions, then samples realistic scenarios from this graph. Using execution feedback, the framework diversifies harmful paths through tool substitution and refines blocked steps, achieving a 1.77× higher harmful path rate than STAC and 2.99× greater tool coverage across four frontier agentic models.
arXiv Computation and Language
Sep 11
Emergent Risks in Generative Multi-Agent Systems
The paper reports a pioneering study on emergent risks in generative multi‑agent systems, focusing on scenarios such as competition over shared resources, sequential handoff collaboration, and collective decision aggregation. It finds that group behaviors like collusion‑like coordination and conformity arise frequently across varied interaction conditions, mirroring known human societal pathologies even without explicit instructions. These risks cannot be mitigated by existing agent‑level safeguards alone, highlighting a social intelligence risk inherent to intelligent multi‑agent collectives.
arXiv AI
Aug 20
Adversarial Review: Structured Disagreement for Grounded Agentic Code Review
Adversarial Review (AR) is a minimal cooperative code‑review protocol that employs a main coding agent, a reviewer, and a critic. The reviewer evaluates code while the critic audits the review through structured disagreement before the main agent edits. On multiple benchmarks (LiveCodeBench, SWE‑PRBench, SWE‑bench Verified), AR achieves higher pass rates or F1 scores than larger multi‑agent baselines, demonstrating that effective code review can be achieved with only three agents and minimal, evidence‑grounded disagreement.
arXiv AI
Sep 7
CABAL: Multi-Agent Simulacra for Tracing the Effects of Collusive Bidding in Peer Review
The paper introduces CABAL, an end-to-end multi-agent simulation framework that models reviewer assignment in academic conferences using large language model-driven reviewer agents. It presents an affinity-guided collusive bidding strategy that forms collusion rings based on reviewer-paper affinities, leading to more effective target-paper capture and higher scores for colluding reviewers. Experiments show that while collusive bidding significantly increases target-paper capture and reviewer scores, overall conference-wide effects are modest, and existing bid-phase detectors offer limited detection capability.
arXiv AI
Oct 16
PROBE: Learning to Audit Policy Compliance in Tool-Using LLM Agents
PROBE is an algorithm that trains language‑model auditors to probe deployed tool‑using agents for policy violations through realistic, multi‑turn, tool‑mediated dialogue. By framing auditing as a two‑player Markov game and using a composite reward that balances violation discovery, behavioral plausibility, conversation progress, and policy diversity, PROBE outperforms zero‑shot adversaries in uncovering broader and higher‑yield policy violations. The study compares GRPO, DPO, and GFlowNet optimizations, demonstrating that multi‑turn behavioral auditing is a distinct and necessary axis of agent evaluation, complementing existing capability and safety benchmarks.