Hugging Face Trending Papers

Local Updates, Global Learning (LUGL): Playing Games with non-incremental Learners

The paper introduces Local Updates, Global Learning (LUGL), a framework that separates data collection from model training, allowing non‑incremental learners such as gradient‑boosted trees (LightGBM) to be used in reinforcement learning for games. LUGL alternates between a local phase—where self‑play generates tabular updates—and a global phase—where these updates train a function approximator before resetting the table. Experiments on both perfect‑information and imperfect‑information games show that LightGBM agents perform competitively or better than neural‑network baselines like DQN and DeepCFR.

arXiv AI
Sep 4

Local Updates, Global Learning (LUGL): Playing Games with non-incremental Learners

The paper introduces LUGL (Local Updates, Global Learning), a framework that separates data collection from model fitting, allowing non‑incremental learners such as gradient‑boosted trees (LightGBM) to be used in reinforcement learning for games. LUGL alternates between a local update phase—where agents play self‑play games and store tabular updates—and a global learning phase—where a function approximator is trained on the accumulated table before it is reset. Experiments on both perfect‑information and imperfect‑information games show that LightGBM‑based agents perform competitively or better than neural‑network baselines like DQN and DeepCFR.

By David Milec, Spyridon Samothrakis, Michael Fairbank, Dennis J. N. J. Soemers
arXiv AI
Oct 9

Can Jev be Your Q or Policy in Reinforcement Learning?

The paper investigates the use of Jev, a decision model that produces calibrated, typed answers in a single forward pass, as a component in reinforcement learning (RL). It shows that Jev can satisfy most requirements of RL systems except providing a value function, and proposes algorithms that use Jev as a reference policy, exploration judge, and replay rater. Experiments on MiniGrid and Atari tasks demonstrate that incorporating Jev improves sample efficiency, exploration, and learning performance compared to a standard RL learner, even when the learner alone fails to progress.

By Yi Ma, Tianpei Yang, Yaodong Yang, Weixun Wang, Hongyao Tang
arXiv Machine Learning
Oct 15

Selective Growing Q-Networks (SGQN): An Analysis of Adaptive Action Grids in Decoupled Q-Learning

Selective Growing Q‑Networks (SGQN) extend value‑based Q‑learning for continuous control by replacing uniform action‑grid growth with an adaptive grid that adds bins near high‑Q regions and prunes low‑Q bins, while maintaining decoupled Q‑learning and epsilon‑greedy action selection. On eight DeepMind Control Suite tasks, SGQN achieves the highest mean final return on four tasks, matches the best method within 1.1% on three more, and uses on average 7.5 of 9 available bins per dimension. Experiments show that the adaptive grid’s growth and pruning have limited impact on performance, whereas starting from a coarse grid and using epsilon‑greedy selection are critical for success.

By Parham Nooranbakht, Seyed Mahdi Basiri Azad, Joschka B\"odecker