arXiv AI
The Surprising Effectiveness of Approximate Value Iteration in Self-Play
Read the original on arXiv AI →The Flow has not summarised this story yet — read it at arXiv AI.
Related stories
arXiv AI
Sep 30
Engineering Efficient Self-Play Chess: Search, Replay, and Throughput Under Limited Compute
arXiv:2609.37447v1 Announce Type: cross Abstract: How strong can an AlphaZero-style chess system become under limited training compute when its entire learning loop is engineered for efficiency? We t...
arXiv AI
Jul 13
AlphaZero in Sparsely Rewarded Games: Limits and Auxiliary Supervision
arXiv:2607. 08984v1 Announce Type: cross Abstract: AlphaZero has demonstrated that a neural-guided Monte Carlo Tree Search can achieve superhuman performance, but strong play does not necessarily imply perfect play.
arXiv Machine Learning
Oct 7
Particle Monte Carlo Tree Search
arXiv:2605.08982v4 Announce Type: replace Abstract: Monte Carlo Tree Search (MCTS) is a widely used approach for policy improvement and action selection in Reinforcement Learning. Due to its sequenti...
arXiv AI
Sep 17
Online Robust Reinforcement Learning Through Monte-Carlo Planning
The paper introduces a robust variant of Monte Carlo Tree Search that addresses ambiguities in transition dynamics and reward distributions, bridging the gap between simulation-based planning and real-world deployment. It incorporates a robust power mean backup operator and exploration bonuses to guarantee finite-sample convergence at every node, achieving an ≠O(n−1/2) convergence rate for root value estimation comparable to standard MCTS. Empirical results demonstrate robust performance in planning tasks even under significant model mismatches.
arXiv Machine Learning
Aug 18
PureTD: Reinforcement Learning for Backgammon Money Games with No Evaluation-time Search
arXiv:2608. 15146v1 Announce Type: new Abstract: We revisit Tesauro's TD-Gammon for backgammon money games in the setting of no evaluation-time search.
arXiv AI
Oct 15
Learning to Play: Reinforcement Learning and Games
arXiv:2610.17391v1 Announce Type: new Abstract: Amazing breakthroughs in reinforcement learning have taken place. Computers teach themselves to play Chess and Go and beat world champions. There is ta...