arXiv Machine Learning June 9, 2026 By Vladimir Braverman, Chen Wang, Liudeng Wang, Samson Zhou

Online Learning with Recency: Algorithms for Sliding-window Streaming Multi-armed Bandits

Read the original on arXiv Machine Learning →

arXiv:2606. 08977v1 Announce Type: new Abstract: Motivated by the recency effect in online learning, we study algorithms for single-pass *sliding-window streaming multi-armed bandits (MABs)* in this paper.

Machine-generated by The Flow from the publisher's headline and feed description — not written or checked by a human. The full article lives at arXiv Machine Learning.

arXiv Machine Learning

Jun 2

Finite-Time Regret Analysis of Retry-Aware Bandits

arXiv:2605. 20854v2 Announce Type: replace Abstract: We study a stochastic bandit algorithm motivated by retry-aware objectives that value the best outcome among multiple attempts, such as pass@$k$ and max@$k$.

By Bingkui Tong, Junpei Komiyama, Soichiro Nishimori, Paavo Parmas

reinforcement-learning

arXiv Machine Learning

Jun 9

Multi-Armed Bandits with Arriving Arms: Sequential Screening, Dynamic Regret, and Sublinear Guarantees

arXiv:2606. 09002v1 Announce Type: cross Abstract: We study a stochastic multi-armed bandit problem in which the set of available arms expands over time.

By Deqi Zheng, Xiaoyang Xu, Yuhong Yang

reinforcement-learning benchmarks

arXiv Machine Learning

2d ago

Rising Multi-Armed Bandits with Known Horizons

arXiv:2602.10727v3 Announce Type: replace Abstract: Rising Multi-Armed Bandits (RMABs) model sequential decision problems where each arm's expected reward improves with repeated pulls. In such proble...

By Seockbean Song, Chenyu Gan, Youngsik Yoon, Siwei Wang, Wei Chen, Jungseul Ok

reinforcement-learning benchmarks

arXiv Machine Learning

Sep 22

Multi-Armed Bernoulli Bandits via Minimax Single-Arm Stopping

arXiv:2609. 22690v1 Announce Type: new Abstract: We develop an index policy for finite-horizon Bernoulli multi-armed bandits from minimax solutions to single-arm bandit (SAB) problems.

By Huikang Liu, Zhengchao Wang, Daniel Kuhn, Wolfram Wiesemann

reinforcement-learning benchmarks

arXiv Machine Learning

2d ago

Regret Analysis of Retry-Based Bandits

arXiv:2605.20854v3 Announce Type: replace Abstract: We provide the first regret analysis of ReMax in stochastic multi-armed bandits. Originally introduced for reinforcement learning, ReMax is motivat...

By Bingkui Tong, Junpei Komiyama, Soichiro Nishimori, Paavo Parmas

reinforcement-learning

arXiv Machine Learning

Jun 29

Learning in Markovian bandits with non-observable states and constrained decision epochs

arXiv:2606. 27448v1 Announce Type: new Abstract: This paper studies the problem of regret minimization in Markovian bandits with \emph{non-observable states} and possibly \emph{constrained} decision epochs.

By Thomas Hira, Victor Boone, Urtzi Ayesta, Ina Maria Verloop

reinforcement-learning benchmarks safety

One email a morning, machine-written

Related stories

Finite-Time Regret Analysis of Retry-Aware Bandits

Multi-Armed Bandits with Arriving Arms: Sequential Screening, Dynamic Regret, and Sublinear Guarantees

Rising Multi-Armed Bandits with Known Horizons

Multi-Armed Bernoulli Bandits via Minimax Single-Arm Stopping

Regret Analysis of Retry-Based Bandits

Learning in Markovian bandits with non-observable states and constrained decision epochs