arXiv AI

Evolutionarily Stable Stackelberg Equilibrium

arXiv:2603. 18385v3 Announce Type: replace-cross Abstract: We present a new solution concept called evolutionarily stable Stackelberg equilibrium (SESS).

arXiv Machine Learning
Aug 17

What preferences can - and cannot - predict in multi-agent online learning

arXiv:2608. 13810v1 Announce Type: cross Abstract: We examine the interplay between ordinal, preference-based solution concepts in games and the long-run behavior of game dynamics, asking in particular to what extent the combinatorial data of a game -- its preference graph -- determine the outcomes of no-regret learning dynamics -- such as follow-the-regularized-leader (FTRL).

By Omar Abbadi, Rida Laraki, Panayotis Mertikopoulos
arXiv AI
Sep 15

An Evolutionary Computation Framework for Multi-Agent Q-Learning with Mean-Field Environmental Feedback

The paper presents a mean‑field framework for studying multi‑agent Q‑learning in networked populations, where agents update stateless Q‑values on a fixed graph while the average behavior of the population feeds back to modify the payoff matrix. A deterministic transport equation for the distribution of Q‑values is derived and coupled with a discrete update for the environmental state, and the model is validated against Monte Carlo simulations on several random graph topologies. Results show that the mean‑field system captures macroscopic cooperation dynamics, that environmental feedback reshapes action‑value ordering, and that the timescale of environmental response critically influences learning outcomes.

By Lichen Wang, Shijia Hua, Linjie Liu
arXiv AI
Sep 24

Evolutionary Stability Does Not Guarantee Learning Accessibility: A Multi-Agent Reinforcement Learning Perspective on Cooperation Emergence

The paper investigates whether evolutionary stability guarantees that learning agents can achieve cooperative outcomes in a multi‑agent setting. Using a three‑agent governance game, the authors compare the evolutionary basin of attraction with learning basins derived from independent Q‑learning, scaled Boltzmann exploration, and SA–EA BQL. They find that while the evolutionary basin covers the entire sampled grid, only ε‑greedy Q‑learning attains a substantial learning basin, whereas the other methods fail to sustain cooperation, highlighting a disconnect between population‑level stability and finite‑sample learning accessibility.

By Yijie Wang
arXiv Machine Learning
Jun 30

Bridging Rested and Restless Bandits with Graph-Triggering: Rising and Rotting

arXiv:2409. 05980v2 Announce Type: replace-cross Abstract: Rested and Restless Bandits are two well-known bandit settings that are useful to model real-world sequential decision-making problems in which the expected reward of an arm evolves over time due to the actions we perform or due to the nature.

By Gianmarco Genalti, Marco Mussi, Nicola Gatti, Marcello Restelli, Matteo Castiglioni, Alberto Maria Metelli
arXiv Machine Learning
Sep 22

Learning in Structured Stackelberg Games

arXiv:2504.09006v5 Announce Type: replace-cross Abstract: We initiate the study of structured Stackelberg games, a novel form of strategic interaction between a leader and a follower where contextual...

By Maria-Florina Balcan, Kiriaki Fragkia, Keegan Harris
arXiv AI
Jul 7

Serious Games: Human-AI Interaction, Evolution, and Coevolution

arXiv:2505. 16388v2 Announce Type: replace Abstract: The serious games between humans and AI have only just begun.

By Nandini Doreswamy (Southern Cross University, Lismore, New South Wales, Australia, National Coalition of Independent Scholars), Louise Horstmanshof (Southern Cross University, Lismore, New South Wales, Australia)