The paper addresses an online resource allocation problem where a budget must be distributed among multiple arms under censored feedback. Each arm yields a reward only if it is activated by an unknown Bernoulli process and the allocated budget exceeds a random threshold from an unknown parametric distribution. The authors establish a worst‑case regret lower bound of Σ(√T), propose the RA‑UCB algorithm achieving near‑optimal regret when the budget is known, and introduce MG‑UCB for unknown, round‑dependent budgets, validating both approaches experimentally.
By Giovanni Montanari, C\^ome Fiegel, Corentin Pla, Aadirupa Saha, Vianney Perchet
arXiv:2609.37932v1 Announce Type: new
Abstract: Systems operating in dynamic environments require timely updates to sustain performance. For resource-intensive systems such as machine learning models...
By Qiulin Lin, Junyan Su, Liyuan Wang, Minghua Chen
The paper studies high‑dimensional linear contextual bandits with knapsack constraints (CBwK), aiming to exploit sparsity for tighter regret bounds. It introduces an online hard‑thresholding estimator integrated into a primal‑dual framework, achieving sub‑linear regret that grows only logarithmically with the feature dimension. Under either a diverse‑covariate or margin condition, the regret improves to τ‑dependent rates, and when both hold simultaneously, a dual resolving scheme yields an even tighter bound. The approach also recovers optimal rates for high‑dimensional contextual bandits without knapsacks, and experiments demonstrate its practical effectiveness.
By Wanteng Ma, Dong Xia, Jiashuo Jiang
arXiv:2610.07615v1 Announce Type: new
Abstract: Active Feature Acquisition (AFA) is a classification problem in which an agent decides which costly features to acquire before predicting each sample's...
By AbdAlRahman Odeh, Teng-Hui Huang, Hesham El Gamal
arXiv:2608. 11383v1 Announce Type: new Abstract: We study new algorithms for Contextual Bandits with Knapsack.
By Zhen Xu
arXiv:2607. 29460v1 Announce Type: new Abstract: Heavy-tailed distributions arise naturally in sequential decision-making problems such as financial investment, online advertising, and network management, where rare but extreme outcomes can dominate performance.
By Gianmarco Genalti, Alberto Maria Metelli
arXiv:2602.10727v3 Announce Type: replace
Abstract: Rising Multi-Armed Bandits (RMABs) model sequential decision problems where each arm's expected reward improves with repeated pulls. In such proble...
By Seockbean Song, Chenyu Gan, Youngsik Yoon, Siwei Wang, Wei Chen, Jungseul Ok
arXiv:2606. 09002v1 Announce Type: cross Abstract: We study a stochastic multi-armed bandit problem in which the set of available arms expands over time.
By Deqi Zheng, Xiaoyang Xu, Yuhong Yang
The paper introduces Persistent Candidate LinUCB (PC‑LinUCB), a variant of the LinUCB algorithm for linear bandits that reduces per‑round score evaluations from ≥×K to ≥×(k+q) by maintaining a small set of active actions and sampling challengers from the remaining actions. It provides high‑probability regret bounds that include a standard learning term and an additive discovery cost of order ≥×((K-k)×log(K-k))/q, which does not grow with the horizon. Experiments demonstrate that PC‑LinUCB accelerates LinUCB while keeping regret comparable, and the persistent candidate approach can be applied beyond LinUCB.
By Bingkui Tong, Daria Korovaitceva, Marina Sheshukova, Sergey Samsonov, Junpei Komiyama
arXiv:2607. 23765v1 Announce Type: cross Abstract: Large language models (LLMs) achieve impressive performance across multiple domains, but using the most capable model for every query is prohibitive at scale.
By Yifei Li, Zihui Gao, Laks V. S. Lakshmanan
arXiv:2610. 29381v1 Announce Type: new Abstract: We propose a novel stochastic cascading bandit setup where probing an ordered shortlist of $K$ out of $L$ arms incurs position-dependent costs, and the learner observes only noisy feedback regarding each arm's true output.
By Yashaswini Kaluguri, Nikhil Karamchandani
We study the contextual combinatorial semi-bandit (CCSB) problem with general reward function approximation. At each round, the learner observes a context, selects a combinatorial action consisting of a subset of basic arms, and receives the reward of each selected arm; the goal is to maximize the cumulative reward over time.