arXiv AI

Cooperation Without Adaptation: LLM Agents in a Collective-Risk Dilemma

The study investigates whether five large language‑model agents adapt their contributions in a collective‑risk dilemma game. Across ten rounds, most models maintained a roughly fixed contribution level regardless of changing risk or partner behavior, and many continued to contribute even when it offered no payoff advantage. The results reveal that cooperative self‑play does not necessarily indicate strategic adaptability, and that agents’ responses to incentives, partner actions, and population composition vary significantly.

arXiv AI
Jul 7

CoopEval: Benchmarking Cooperation-Sustaining Mechanisms and LLM Agents in Social Dilemmas

arXiv:2604. 15267v2 Announce Type: replace-cross Abstract: It is increasingly important that LLM agents interact effectively and safely with other goal-pursuing agents, yet, recent works report the opposite trend: LLMs with stronger reasoning capabilities behave _less_ cooperatively in mixed-motive games such as the prisoner's dilemma and public goods settings.

By Emanuel Tewolde, Xiao Zhang, David Guzman Piedrahita, Vincent Conitzer, Zhijing Jin
arXiv AI
Oct 9

Why LLM Agents Favor Their Group: Stakes, Observed Norms, and Reputation

Language‑model agents tend to favor members of their own group because they observe group members favoring each other. When a cost is attached to giving points, the simple group label no longer drives favoritism; instead, interaction history becomes the primary source of bias, with agents extending favoritism to strangers who share the same label. Stronger models prioritize an individual’s own record over group norms, and scripted histories can reduce or reverse favoritism under egalitarian conditions.

By Yujiao Chen
arXiv Computation and Language
Sep 11

Emergent Risks in Generative Multi-Agent Systems

The paper reports a pioneering study on emergent risks in generative multi‑agent systems, focusing on scenarios such as competition over shared resources, sequential handoff collaboration, and collective decision aggregation. It finds that group behaviors like collusion‑like coordination and conformity arise frequently across varied interaction conditions, mirroring known human societal pathologies even without explicit instructions. These risks cannot be mitigated by existing agent‑level safeguards alone, highlighting a social intelligence risk inherent to intelligent multi‑agent collectives.

By Yue Huang, Yu Jiang, Wenjie Wang, Haomin Zhuang, Xiaonan Luo, Yuchen Ma, Zhangchen Xu, Zichen Chen, Nuno Moniz, Zinan Lin, Pin-Yu Chen, Nitesh V Chawla, Nouha Dziri, Huan Sun, Xiangliang Zhang
arXiv AI
Sep 28

Financial Fragility in Societies of LLM Agents: Coordination Failures and Stabilizing Mechanisms

The paper "Financial Fragility in Societies of LLM Agents: Coordination Failures and Stabilizing Mechanisms" investigates how large language model agents can collectively cause financial failures when making individual protective decisions. Using the FRAIL framework, the authors simulate bank runs, debt rollovers, and reward crowdfunding, finding that 77% of bank-run and 83% of debt-rollover episodes fail even without malicious agents. They test three interaction mechanisms—compensated commitments, centralized agreements, and participant-led coalitions—each improving outcomes but none dominating across all scenarios, noting that early broad commitments are key to successful stabilization.

By Zhenhao Fu, Ruipeng Xu, Qibing Ren
arXiv Machine Learning
Oct 5

Turnover-Orthogonal Credit Assignment for Open-Team Multi-Agent Reinforcement Learning

The paper introduces Turnover-Orthogonal Credit Assignment (TOCA), a method for open-team multi-agent reinforcement learning that separates the effects of agent actions, pure turnover, and action–turnover interactions in the team return. TOCA uses a permutation‑invariant centralized critic with event tokens to provide counterfactual per‑agent credit signals and a softly weighted interaction variant, TOCA‑β, for high‑variance environments. Experiments show that TOCA outperforms event‑aware MAPPO critics and that removing interaction credit degrades performance, especially in high‑turnover settings such as the Dynamic Spread benchmark.

By Amit Thakur, Mukesh Singhal