arXiv AI

Learning and Steering in Incomplete-Information Games

arXiv AI
Jul 10

Provably Optimal Learning Algorithms for Assistance Games

arXiv:2607. 08012v1 Announce Type: cross Abstract: This paper studies an online variant of the assistance games framework, where an informed agent and an uninformed agent repeatedly interact over $T$ timesteps to optimize a common reward function.

By Nivasini Ananthakrishnan, Mark Bedaywi, Michael I. Jordan, Stuart Russell, Nika Haghtalab
arXiv Machine Learning
5d ago

When Is a Game a Markov Decision Process? Correspondences Between Game Theory and Reinforcement Learning

The paper establishes formal theorems linking game theory and reinforcement learning, showing that a game can be viewed as a Markov decision process in three distinct ways—definitional identity, exact reduction, or structural analogy. It systematically maps every standard game class and solution concept to corresponding reinforcement learning models, training procedures, and complexity results. The work also identifies where these correspondences break down, such as non‑stationarity, impossibility of uncoupled convergence to Nash equilibrium, and gaps between coarse correlated and correlated equilibria.

By Eduardo C. Garrido-Merch\'an
arXiv Machine Learning
Sep 2

NashDreamer: Model-Based Reinforcement Learning for Zero-Sum Imperfect-Information Games

NashDreamer is a new model-based reinforcement learning framework designed for two-player zero-sum imperfect-information games. It introduces a centralized Multi-Agent Recurrent State-Space Model that separates environment dynamics from player strategy effects, enabling the use of any policy gradient algorithm while preserving convergence guarantees to Nash equilibria. Experiments on four benchmark games show that NashDreamer achieves significantly better sample efficiency than model-free baselines early in training, and the authors analyze its optimization landscape, noting a potential vulnerability to posterior collapse in stochastic settings.

By Tom\'a\v{s} Hole\v{c}ek, Viliam Lis\'y
arXiv Machine Learning
Sep 14

Independent Learning of Nash Equilibria in Partially Observable Markov Potential Games with Decoupled Dynamics

The paper investigates learning Nash equilibria in partially observable Markov games (POMGs) where agents cannot fully observe the state. By focusing on a subclass with independent state transitions and a Markov potential game structure, the authors propose an independent learning algorithm that allows agents to converge to an approximate Nash equilibrium using only their own observations and actions, without communication. Under a filter stability assumption, finite‑history policies are shown to approximate the POMG sufficiently, enabling a surrogate near‑potential Markov game and yielding quasi‑polynomial sample and computational complexity.

By Philip Jordan, Maryam Kamgarpour