arXiv AI

BluffJAX: Adversarial Imperfect Information Games in JAX

BluffJAX is an open‑source suite of adversarial imperfect‑information games implemented in JAX, designed for high‑throughput simulation and GPU parallelization. It includes classic benchmarks like Texas Hold’Em and Kuhn Poker, as well as newer games such as Bluff, Stud Poker, and Kemps, aiming to broaden research in game‑theoretic reinforcement learning. The authors benchmarked throughput, memory usage, and algorithmic performance across single and multi‑GPU setups, showing scalability to hundreds of millions of samples per second and providing baseline results for future work.

arXiv Machine Learning
5d ago

JAXtari: High-Throughput and Easy-to-Modify Arcade Learning Environment

JAXtari is an open‑source, high‑performance reimplementation of Atari 2600 environments that enables massive GPU parallelization. It allows PPO agents to complete 100 M environment steps on a single A100‑GPU in under an hour, far faster than the CPU‑based ALE. Additionally, JAXtari provides object‑centric observations and a flexible modification system, facilitating research into causal modeling, neuro‑symbolic methods, and rapid agent adaptation.

By Quentin Delfosse, Raban Emunds, Paul Seitz, Sebastian Wette, Jannis Bl\"uml, Daniel Kirn, Dominik Mandok, Kristian Kersting
Hugging Face Trending Papers
Jul 7

FootsiesGym: A Fighting Game Benchmark for Two-Player Zero-Sum Imperfect-Information Games

We present FootsiesGym, an open-source environment for learning in a non-trivial two-player, zero-sum, imperfect-information game. Built on HiFight's minimalist 2D fighting game Footsies, it isolates the cyclic, non-transitive strategic interactions of fighting game neutral play while remaining simple enough for efficient analysis.

arXiv Machine Learning
Oct 5

Mastering Atari 2600 Games with Discovered Options

Wayfarer is a domain‑agnostic, online deep RL agent that discovers options via Laplacian representation learning from high‑dimensional observations and uses them for control. The discovered options improve exploration, accelerate credit assignment, and generalise to unseen settings, leading to faster learning of complex policies. Wayfarer achieves state‑of‑the‑art performance among single‑stream agents on the most challenging Atari 2600 games, especially those requiring long‑horizon exploration such as Montezuma's Revenge and Private Eye.

By Erik M. Lintunen, Marlos C. Machado
arXiv Machine Learning
Aug 7

IFlowNets: Extending Generative Samplers to Learn Strategies in Incomplete Information Games

arXiv:2608. 05422v1 Announce Type: new Abstract: While many algorithms blend reinforcement learning (RL) with counterfactual regret (CFR) methods to leverage tradeoffs in computational speed and performance, there are fewer investigations into generative sampling frameworks in game theoretic applications in incomplete information games.

By Conor M. Artman, Nicholas Di, Scott Perkins