arXiv AI

Belief-Conditioned Multi-Agent Actor Critic for Decentralized LLM Collaboration

arXiv AI
Sep 10

MARBO: Relational Belief Grounding for LLM Agents in Social Deduction Games

The paper introduces MARBO, a framework that grounds large language model agents’ actions and speech in relational beliefs about hidden roles and team alignments in social deduction games. By providing preference feedback only when behaviors are supported by reliable relational beliefs and lead to favorable outcomes, MARBO encourages consistent learning under uncertainty. Experiments demonstrate that compact LLM agents using MARBO consistently outperform existing baselines in representative social deduction games.

By Hwang Yechan, Bae Sangjun, Kim Jeongmo, Bang Sangwoo, Han Seungyul
arXiv AI
Oct 31

EpiAgent: Epistemic Self-Play for LLM Agents

EpiAgent introduces an explicit, learnable epistemic layer for large language model agents, enabling them to maintain and update beliefs about other agents’ private information. The framework splits the policy into Epistemic Update and Action Planning stages, optimized via a bi‑level Epistemic Self‑Play algorithm that rewards accurate belief predictions. Experiments in mixed and competitive settings show EpiAgent outperforms prompting and RL baselines, highlighting the benefits of dedicated epistemic training for belief inference and action planning.

By Xuanfa Jin, Xinyu Cui, Zhijian Ma, Xue Yan, Jian Zhao, Haifeng Zhang, Jun Wang
arXiv AI
Oct 9

MA-JEPA: Joint-Embedding World Models for Multi-Agent Reinforcement Learning

MA-JEPA is a stochastic world model designed for multi‑agent reinforcement learning that replaces observation reconstruction with joint‑embedding prediction. It uses a categorical latent state and a causal Transformer trained on posterior and action‑conditioned dynamics to generate imagined trajectories for actor‑critic learning. The model achieves strong performance on the SMAC benchmark, matching or surpassing the best reported mean win rates on half of the evaluated maps.

By Brandon Gary Kaplowitz, Osaze James Obahor, Christian Schroeder de Witt
arXiv Machine Learning
Aug 6

Communication-Enhanced Tutoring for Efficient Decentralized Multi-Agent Reinforcement Learning

arXiv:2508. 13661v4 Announce Type: replace Abstract: Centralized Training with Decentralized Execution (CTDE) is the dominant paradigm in multi-agent reinforcement learning (MARL), enabling agents to act independently at test time while leveraging additional information during training.

By Maciej Wojtala, Bogusz Stefa\'nczyk, Dominik Bogucki, {\L}ukasz Lepak, Pawe{\l} Wawrzy\'nski
arXiv Machine Learning
Oct 15

Narrowing the Collaboration Gap, Probably

arXiv:2610.19215v1 Announce Type: new Abstract: Large language models are increasingly deployed as teams of agents that hold different private information about a shared task. How should such agents...

By Mirah Shi, Marcel Hussing, Ira Globus-Harris, Natalie Collina, Aaron Roth, Surbhi Goel
arXiv AI
Jul 14

Multi-Agent LLMs Fail to Explore Each Other

arXiv:2607. 11250v1 Announce Type: cross Abstract: Exploration is essential for reliable autonomy in multi-agent systems, yet it remains unclear whether large language model (LLM) agents can explore effectively when interacting with one another.

By Hyeong Kyu Choi, Jiatong Li, Wendi Li, Xin Eric Wang, Sharon Li