arXiv AI By Max Yu

PokaiTrainer: Scaling Belief-State Search to Competitive Pok\'emon VGC

Read the original on arXiv AI →

PokaiTrainer is a competitive Pokémon VGC agent that scales belief‑state search to handle simultaneous, large joint action spaces and stochastic outcomes. The system uses PokaiEngine, a Rust battle engine that efficiently enumerates joint action outcomes with high accuracy, and adapts Student of Games to solve each decision as a Bayesian matrix game under a compute budget. In live Showdown play, the agent achieved a 59% win rate against a human field averaging ~1320 Elo, reaching an Elo band of 1350‑1400 and briefly entering the top 500 of the format.

Machine-generated by The Flow from the publisher's headline and feed description — not written or checked by a human. The full article lives at arXiv AI.

arXiv AI
Sep 18

Efficient Nash Equilibrium Computation for Cybersecurity Games

The paper introduces Regret-Weighted Payoff Sampling (RWPS), a budgeted estimator that selectively simulates only payoff-matrix cells relevant to a Nash equilibrium and uses a surrogate model for the remaining entries. RWPS provides an instance-dependent error bound weighted by the opponent’s equilibrium mixture and a coverage result guaranteeing that, once the deviation-relevant set is simulated, surrogate error does not affect either player’s regret. Experiments on three 21×21 general-sum games, including an asymmetric Colonel Blotto, show that RWPS achieves four to six times tighter bounds than previous methods and outperforms other sampling strategies on the CyGym and ANSG cyber simulators at low budgets.

By Michael Lanier, David Farmer, Yevgeniy Vorobeychik
arXiv Machine Learning
Jun 8

High entropy leads to symmetry-equivariant policies in Dec-POMDPs

arXiv:2511. 22581v5 Announce Type: replace Abstract: We prove that in any Dec-POMDP, sufficiently high entropy regularization ensures that the policy gradient flow with tabular softmax parametrization always converges, for any initialization, to the same joint policy, and that this joint policy is equivariant w.

By Johannes Forkel, Constantin Ruhdorfer, Michael Beukman, Andreas Bulling, Jakob Foerster