arXiv Machine Learning By Eduardo C. Garrido-Merch\'an

When Is a Game a Markov Decision Process? Correspondences Between Game Theory and Reinforcement Learning

Read the original on arXiv Machine Learning →

The paper establishes formal theorems linking game theory and reinforcement learning, showing that a game can be viewed as a Markov decision process in three distinct ways—definitional identity, exact reduction, or structural analogy. It systematically maps every standard game class and solution concept to corresponding reinforcement learning models, training procedures, and complexity results. The work also identifies where these correspondences break down, such as non‑stationarity, impossibility of uncoupled convergence to Nash equilibrium, and gaps between coarse correlated and correlated equilibria.

Machine-generated by The Flow from the publisher's headline and feed description — not written or checked by a human. The full article lives at arXiv Machine Learning.

arXiv Machine Learning
Oct 5

Normal-Form Correlation in Markov Games

arXiv:2610.03621v1 Announce Type: cross Abstract: There has been a surge of recent work on correlated equilibrium concepts in Markov games. However, existing results focus on concepts weaker than nor...

By Ioannis Anagnostides, Constantinos Daskalakis, Gabriele Farina, Noah Golowich, Tuomas Sandholm, Brian Hu Zhang
arXiv Machine Learning
Aug 14

Decentralized Multi-Player Q-Learning in Episodic Markov Decision Processes with Information Asymmetry

arXiv:2608. 12753v1 Announce Type: new Abstract: We study decentralized multi-player reinforcement learning in episodic tabular Markov decision processes (MDPs) under three forms of information asymmetry: (A) unobserved actions with common rewards, (B) observed actions with independent rewards, and (C) unobserved actions with independent rewards.

By Larissa Xu, King Bi, William Chang