arXiv Statistics ML

On the Complexity of Best-Arm Identification in Non-Stationary Linear Bandits

arXiv:2603. 10346v2 Announce Type: replace Abstract: We study the fixed-budget best-arm identification (BAI) problem in non-stationary linear bandits.

arXiv Machine Learning
Jun 15

A Complexity Measure for Active Learning in Multi-group Mean Estimation

arXiv:2606. 14690v1 Announce Type: new Abstract: We study a \emph{max-risk} objective for active learning in a multi-group mean estimation $d$-armed bandits: a learner adaptively allocates a budget of $T$ samples across $d$ groups to minimize the worst-case uncertainty index $\max_{k\in[d]}\sigma_k^2/n_k$, where $\sigma_k$ is the standard deviation of the distribution of arm $d$, and $n_k$ is the number of times arm $d$ is sampled.

By Abdellah Aznag, Rachel Cummings, Adam N. Elmachtoub
arXiv AI
Oct 2

Bandits with Multiple Optimal Arms: Minimax Regret and Non-Adaptivity

The paper investigates multi‑armed bandits where several arms are optimal. It refines previous sub‑sampling algorithms to achieve a minimax regret of τO((K−A)/√(KA)·√T), improving on earlier bounds. A matching lower bound is provided, showing the rate is nearly optimal, and the authors demonstrate that knowing the number of optimal arms A (within constant factors) is essential for near‑optimal performance.

By Kaixuan Ji, Qiwei Di, Qingyue Zhao, Heyang Zhao, Quanquan Gu
arXiv Machine Learning
Oct 16

Transfer Learning in Bandits from Unknown Adaptive Policies: Problem-Dependent Lower and Upper Bounds

The paper investigates transfer learning in stochastic multi‑armed bandits when historical data come from an unknown adaptive policy. It establishes asymptotic problem‑dependent lower bounds and introduces the KL‑UCB‑Transfer algorithm, which combines online and historical data to achieve logarithmic regret with an improved constant under certain mean‑gap conditions. The study also relaxes the source‑target discrepancy assumption to a one‑sided condition, demonstrating that logarithmic regret can still be achieved under misspecification and identifying regimes of improvement, degradation, or loss of guarantee.

By Adrien Prevost, Timothee Mathieu, Waris Radji, Odalric-Ambrym Maillard
arXiv Machine Learning
6d ago

Learning to Allocate Resources with Censored Feedback

The paper addresses an online resource allocation problem where a budget must be distributed among multiple arms under censored feedback. Each arm yields a reward only if it is activated by an unknown Bernoulli process and the allocated budget exceeds a random threshold from an unknown parametric distribution. The authors establish a worst‑case regret lower bound of Σ(√T), propose the RA‑UCB algorithm achieving near‑optimal regret when the budget is known, and introduce MG‑UCB for unknown, round‑dependent budgets, validating both approaches experimentally.

By Giovanni Montanari, C\^ome Fiegel, Corentin Pla, Aadirupa Saha, Vianney Perchet