arXiv Machine Learning

The Deceptive Bandit Problem: Exploratory Coupling and the Fragility of Multi-Agent Learning

The paper investigates how randomized exploration in bandit learning can be compromised when an adversarial agent gains access to another agent’s exploratory signals. In a two‑player strongly monotone setting, the deceptive agent couples its actions with the leaked information to steer the learning dynamics toward a new steady state, termed the deceptive Nash equilibrium (DNE). The authors prove that the deceptive bandit learning dynamics converge to an arbitrarily small neighborhood of the DNE while maintaining optimal convergence rates, even under relaxed smoothness assumptions, and illustrate the impact on costs in a resource‑allocation game.

arXiv Machine Learning
Oct 8

Beyond Reward Suppression: Near-Optimal Offline Attacks on Warm-Start Bandits with Bounded Rewards

The paper introduces a new class of offline adversarial attacks on warm‑start bandit algorithms with bounded rewards. Unlike prior methods that suppress non‑target arms, the authors show that promoting the target arm is essential when it lies near the lower reward boundary, and they design an attack that achieves optimal sublinear cost by balancing target promotion and non‑target suppression. The attack is extended to several popular bandit algorithms and validated experimentally on real‑world and synthetic data.

By Qirun Zeng, Manhin Poon, Xiangxiang Dai, Qixin Zhang, Jinhang Zuo
arXiv Machine Learning
3d ago

Characterizing Oblivious Common-Reward Multi-Player Bandits: Universal Stationarity, Coordination Traps, and Certified Global Rates

The paper analyzes the oblivious common-reward multi-player multi-armed bandit (OC-MPMAB), where players act independently without observing others and only share a common reward. It shows that the players’ gradient-bandit updates form an unbiased estimator of a hidden product-policy objective, guaranteeing universal finite‑time first‑order stationarity. The work also identifies conditions under which global optimality cannot be achieved, introduces certificates to recover global optimality under structural assumptions, and establishes corresponding product‑policy gap and pseudo‑regret bounds.

By Mingxiao Li, Wenhai Lai, Hongyu Wang
arXiv AI
Oct 16

Learning Rewards in Strategic Games

The paper investigates how to infer agents’ underlying incentives in strategic multi‑agent settings, where traditional inverse reinforcement learning (IRL) may fail to produce rewards that guide optimal play. It introduces the concept of strategic identifiability and shows that learning from a fixed pair of policies can be insufficient regardless of sample size. To address this, the authors propose an active IRL algorithm for two‑player repeated Stackelberg games, combining maximum‑likelihood estimation with experimental design to achieve finite‑sample guarantees on sub‑optimality, and validate the approach in an anti‑poaching scenario.

By Antoine Bergerault, Cyrille Kone, Giorgia Ramponi