arXiv Machine Learning

Rethinking Successive Rejects Algorithms

The paper revisits the Successive Rejects (SR) algorithm for best‑arm identification, showing that although SR appears non‑adaptive due to fixed phase lengths, it achieves an optimal worst‑instance error exponent for Gaussian arms with common variance. The authors formulate an optimization problem to design a phase schedule that maximizes the normalized error exponent, leading to a new variant called H1‑balanced Successive Rejects (H1‑SR). H1‑SR attains at least 11/12 of the optimal normalized rate for all K ≥ 2, approaching the optimum as K grows, and experiments demonstrate significant performance gains over the original SR while highlighting trade‑offs in early elimination strategies.

arXiv Machine Learning
Oct 8

Best Arm Identification for Bandits with Shifting Means

arXiv:2610. 10488v1 Announce Type: cross Abstract: We study the best arm identification problem in a stochastic environment with a novel form of adversarial perturbations, which we coin Shifting Means.

By Lukas Zierahn, Wouter M. Koolen, Shubhada Agrawal, Christina Katsimerou, Dirk van der Hoeven
arXiv Machine Learning
Oct 23

Bayesian Fixed-Confidence Best-Arm Identification with Abstention

The paper investigates Bayesian fixed‑confidence best‑arm identification where a learner may abstain from a final recommendation. It introduces the Screen‑and‑Confirm (S&C) algorithm, analyzes its expected stopping time, and derives lower bounds for any algorithm under error probability δ and abstention budget α constraints. For Gaussian priors, the authors provide matching upper and lower bounds, characterize exact constants for practical regimes, and show that S&C achieves optimal α–dependent rates, improving on previous results when abstention is disallowed.

By Yuqi Huang, Yunlong Hou, Vincent Y. F. Tan
arXiv Machine Learning
Aug 28

UCB for Large-Scale Pure Exploration: Beyond Sub-Gaussianity

The paper studies upper confidence bound (UCB) algorithms for large‑scale pure exploration problems where the performance distributions may be heavy‑tailed and not sub‑Gaussian. It introduces a meta‑UCB framework that selects the alternative with the largest sample size as the best upon stopping, and derives a distribution‑free lower bound on the probability of correct selection. Using this bound, the authors show that the meta‑UCB algorithm achieves sample optimality in both indifference‑zone and non‑indifference‑zone settings under a uniform variance bound, and provide numerical experiments that illustrate the behavior of UCB algorithms beyond the meta‑UCB framework.

By Zaile Li, Weiwei Fan, L. Jeff Hong
arXiv Machine Learning
Jul 9

Best-Arm Identification with Generative Proxy

arXiv:2607. 06879v1 Announce Type: new Abstract: Best-arm identification is a canonical model for data-driven decision-making, but in many applications each reward observation is costly.

By Tianyi Ma, Hanzhang Qin, Ruihao Zhu, Jierui Zuo