arXiv AI

The Politician, the Liar, and the Obedient Worker: Emerging Behavior of LLM Agents in Hierarchical Games

arXiv:2608. 09574v1 Announce Type: new Abstract: LLMs are rapidly embedding themselves into daily life: drafting our emails, managing our schedules, and making decisions on our behalf.

arXiv Computation and Language
Aug 31

Benchmarking large language model agent societies against human behavioural distributions

The paper introduces SILICA, an open instrument designed to evaluate whether large language model (LLM) agent societies replicate human behavioural distributions. Using five environments with human‑anchored data and perturbations, the study finds that most LLMs only match human behaviour at initial stages, failing to reproduce end‑state cooperation or correct acceptance thresholds. The results suggest that current LLM societies can support exploratory claims but do not yet reliably emulate human social dynamics.

By Raad Bin Tareaf
arXiv AI
Sep 25

How does Adversarial Influence Scale in Multi-Agent Systems?

The paper investigates how deception affects multi‑agent deliberation, finding that the key factor is the proportion of deceivers rather than the total number of agents. Defection rates—instances where initially correct agents adopt incorrect conclusions—grow linearly with the deceiver proportion, and large language model agents are vulnerable even when deceivers are a minority. The study also shows that coordination among deceivers can reduce their effectiveness and that the specific models involved influence susceptibility.

By Addison J. Wu, Jasin Cekinmez, Michel Liao, Karthik Narasimhan, Thomas L. Griffiths
arXiv AI
Aug 26

Strategic Exploitation in LLM Agent Markets: A Simulation Framework for E-Commerce Trust

The paper introduces TruthMarketTwin, a simulation framework that uses agent-based modeling to study large language model (LLM) agents in e‑commerce markets characterized by asymmetric information. It models bilateral trade where sellers and buyers make strategic decisions about listings, purchases, ratings, and recourse to maximize profit and utility. The study finds that LLM agents can autonomously exploit weaknesses in reputation‑based governance, but that warrant enforcement can reduce deception and alter strategic behavior.

By Shijun Lei, Quang Nguyen, Swapneel S Mehta, Zeping Li, Huichuan Fu, Xiaolong Zheng, Siki Chen, Yunji Liang, Philip Torr, Zhenfei Yin
arXiv AI
Jul 7

CoopEval: Benchmarking Cooperation-Sustaining Mechanisms and LLM Agents in Social Dilemmas

arXiv:2604. 15267v2 Announce Type: replace-cross Abstract: It is increasingly important that LLM agents interact effectively and safely with other goal-pursuing agents, yet, recent works report the opposite trend: LLMs with stronger reasoning capabilities behave _less_ cooperatively in mixed-motive games such as the prisoner's dilemma and public goods settings.

By Emanuel Tewolde, Xiao Zhang, David Guzman Piedrahita, Vincent Conitzer, Zhijing Jin
arXiv AI
Sep 21

Why Do LLMs Struggle in Strategic Play? Broken Links Between Observations, Beliefs, and Actions

The paper investigates why large language models (LLMs) struggle in strategic decision-making under incomplete information. It identifies two key gaps: an observation‑belief gap where LLMs’ internal representations of game states are accurate but brittle, and a belief‑action gap where converting these internal beliefs into actions is weak, leading to suboptimal payoffs. Experiments with Llama 3.1, Qwen3, and gpt‑oss confirm that acting optimally on decoded beliefs would improve outcomes in most games, highlighting a bottleneck in belief‑to‑action conversion.

By Jan Sobotka, Mustafa O. Karabag, Ufuk Topcu