arXiv AI

A game theory for foundation models shows new paths to rational cooperation through similarity inference

arXiv:2608. 03958v1 Announce Type: new Abstract: As autonomous agents powered by foundation models are increasingly integrated into social and economic systems, understanding the principles governing their collective behavior is essential for ensuring safety and cooperation.

arXiv AI
Aug 3

Embedded Universal Predictive Intelligence: a coherent framework for multi-agent learning

arXiv:2511. 22226v2 Announce Type: replace Abstract: The standard theory of model-free reinforcement learning assumes that the environment dynamics are stationary and that agents are decoupled from their environment, such that policies are treated as being separate from the world they inhabit.

By Alexander Meulemans, Rajai Nasser, Maciej Wo{\l}czyk, Marissa A. Weis, Seijin Kobayashi, Blake Richards, Guillaume Lajoie, Angelika Steger, Marcus Hutter, James Manyika, Rif A. Saurous, Jo\~ao Sacramento, Blaise Ag\"uera y Arcas
arXiv AI
Jul 16

A Survey on Hypergame Theory: Modelling Misaligned Perceptions and Nested Beliefs for Multi-Agent Systems

arXiv:2507. 19593v3 Announce Type: replace Abstract: Classical game-theoretic models typically assume rational agents, complete information, and common knowledge of payoffs - assumptions that are often violated in real-world MAS characterized by uncertainty, misaligned perceptions, and nested beliefs.

By Vince Trencsenyi, Agnieszka Mensfelt, Kostas Stathis
arXiv AI
Jun 18

Recursive Joint Simulation in Games

arXiv:2402. 08128v3 Announce Type: replace Abstract: Game-theoretic dynamics between AI agents could differ from traditional human-human interactions in various ways.

By Vojtech Kovarik, Caspar Oesterheld, Vincent Conitzer
arXiv AI
Jun 3

Economy of Minds: Emerging Multi-Agent Intelligence with Economic Interactions

arXiv:2606. 02859v1 Announce Type: cross Abstract: How can a population of agents self-orchestrate and self-adapt into stronger collective intelligence without centralized control?

By Zhenting Qi, Huangyuan Su, Ao Qu, Chenyu Wang, Yu Yao, Han Zheng, Kushal Chattopadhyay, Guowei Xu, Zihan Wang, Weirui Ye, Vijay Janapa Reddi, Ju Li, Paul Pu Liang, Himabindu Lakkaraju, Sham Kakade, Yilun Du
arXiv AI
Jun 9

Payoff scaling shapes cooperation in LLM agents across languages

arXiv:2601. 19082v2 Announce Type: replace Abstract: Large language models (LLMs) are increasingly deployed as autonomous agents that negotiate, coordinate, and act on behalf of users.

By Trung-Kiet Huynh, Dao-Sy Duy-Minh, Thanh-Bang Cao, Phong-Hao Le, Hong-Dan Nguyen, Phu-Quy Nguyen-Lam, Minh-Luan Nguyen-Vo, Hong-Phat Pham, Phu-Hoa Pham, Thien-Kim Than, Chi-Nguyen Tran, Huy Tran, Gia-Thoai Tran-Le, Alessio Buscemi, Le Hong Trang, The Anh Han
arXiv AI
Sep 12

Tapes Together Strong: The Co-evolution of Computation and Cooperation

The paper introduces Autopoietic Game Theory, a computational model where social interactions, replication mechanisms, and computational costs co-evolve within a substrate of randomly initialized Z80 machine code programs. By embedding a social dilemma directly into the physics of computation, the authors demonstrate that scarcity of resources can make defection self-limiting, leading to the emergence of self-replicating, cooperative strategies. Empirical results show evolved programs suppress stealing, and spatial assortment enhances structural complexity and task performance, while the framework can also incorporate exogenous pressures such as math tasks tied to computation budgets.

By Kunal Jha, Francesco Cicala, Blaise Ag\"uera y Arcas, Blake Aaron Richards, Natasha Jaques, Max Kleiman-Weiner, Eyvind Niklasson
arXiv Computation and Language
Aug 31

AI Alignment through a Game-theoretic Lens: A Survey

The article surveys AI alignment from a game-theoretic perspective, focusing on how large language models and AI agents can be aligned with complex human values in high-risk settings. It categorizes recent progress around key game-theoretic elements and addresses three main challenges: preference diversity, alignment priority, and temporal dynamics. The survey clarifies where game theory benefits current alignment methods, where its application is looser, and what remains to be tackled for robust, adaptive, and verifiable AI systems.

By Yanan Cai, Zhongrui Zhao, Zhigang Lu, Ickjai Lee, Wei Emma Zhang, Minhui Xue, Yihong Zhang, Shuchao Pang, Wei Xiang