Hugging Face Trending Papers

Beyond Nominal Equilibria: Risk-Averse Multi-Population Mean-Field Games

arXiv Machine Learning
Sep 4

Towards Scaling Reinforcement Learning to Massive Populations: Learning Mean-Field Representations

The paper proposes a mean‑field reinforcement learning framework that models rewards and transitions as functions of an unknown low‑dimensional aggregate statistic of a large agent population. By learning this low‑dimensional representation in an offline setting, the authors demonstrate a provable method for obtaining near‑optimal policies. Experiments on a one‑step routing game inspired by supply‑chain problems show that, with a fixed neural‑network size and optimization budget, the learned representation improves reward prediction and the quality of Nash equilibria compared to baselines that ignore population structure.

By Aditya Makkar, Benjamin Unger, Jeongyeol Kwon, Mathieu Lauri\`ere, Eugene Vinitsky, Yonathan Efroni
arXiv AI
3d ago

Learning to Incentivize Perfect-Knowledge Agents with Unobserved Rewards

The paper studies repeated principal-agent games in a multi-armed bandit setting where the principal offers arm-specific incentives, the agent chooses an arm to maximize its own reward plus incentive, and the principal observes only the chosen arm and its own reward. Because the principal cannot see the agent’s reward, traditional estimation fails, so the authors develop an estimator based on the sequence of incentives and chosen arms, analogous to online inverse optimization. Using this estimator, they design a policy that achieves low (square‑root) regret and validate the approach with simulations for personalized incentive design in long‑term statin treatment.

By Ilgin Dogan, Zuo-Jun Max Shen, Anil Aswani
arXiv Machine Learning
Aug 17

What preferences can - and cannot - predict in multi-agent online learning

arXiv:2608. 13810v1 Announce Type: cross Abstract: We examine the interplay between ordinal, preference-based solution concepts in games and the long-run behavior of game dynamics, asking in particular to what extent the combinatorial data of a game -- its preference graph -- determine the outcomes of no-regret learning dynamics -- such as follow-the-regularized-leader (FTRL).

By Omar Abbadi, Rida Laraki, Panayotis Mertikopoulos
arXiv Machine Learning
Jul 3

Mean Field Reinforcement Learning

arXiv:2607. 01525v1 Announce Type: cross Abstract: This monograph provides an introduction to mean field reinforcement learning through the lens of Markov decision processes arising from large-population stochastic control with mean field interactions and common noise.

By Ren\'e Carmona, Mathieu Lauri\`ere
arXiv AI
Sep 30

Learning to Harvest Without Collapse in a Regenerative Commons: A Lagrangian Framework

The paper introduces a Lagrangian framework for managing a regenerative commons, framing the problem as a constrained Markov game with a specified depletion budget. It constructs policy sequences from unconstrained solutions, extending time‑average concepts to reset episodes with discounted rewards and terminal costs, and provides theoretical guarantees such as reward‑independent feasibility, cooperative feasibility, and approximate optimality. Experiments on a fishery model using constrained IPPO and MAPPO illustrate how depletion budgets influence stock retention, harvest rewards, and price adaptation.

By Jose Tupayachi, Xueping Li, Soham Das