arXiv Statistics ML

Optimal Multiclass Online Regret with Arbitrary Label Spaces

arXiv:2610. 32339v1 Announce Type: cross Abstract: We determine the optimal regret in agnostic multiclass online learning with arbitrary, possibly infinite, label spaces.

arXiv Machine Learning
Sep 21

Optimal Randomized Proper Online Learning

arXiv:2609.21445v1 Announce Type: new Abstract: We prove that the optimal expected mistake bound of online learning a function class $\mathcal{H}$ by a randomized proper learning algorithm is $O(\mat...

By Zachary Chase, Idan Mehalel
arXiv Machine Learning
Oct 9

Optimally Pacing Budget Spending and Learning

arXiv:2610. 11074v1 Announce Type: new Abstract: We establish near-optimal regret bounds for budget-constrained online learning against arbitrary classes of budget-pacing experts in the adversarial setting.

By Mark Braverman, Jingyi Liu, Jieming Mao, Jon Schneider, Eric Xue
arXiv Machine Learning
Oct 19

No-Regret Language Generation

The paper introduces the concept of no‑regret language generation, requiring a generator to make a sublinear number of mistakes across all demonstration sequences and compatible target languages. It presents both a realizable and an agnostic variant, using tree‑based mistake‑forcing dimensions to characterize finite‑horizon minimax complexity and establish necessary and sufficient conditions for no‑regret generation. The authors also connect generation complexity to online prediction, providing optimal mistake bounds for language classes with finite Littlestone dimension.

By Jiaxun Li, Vinod Raman, Ambuj Tewari
arXiv Machine Learning
Sep 22

Learning in Structured Stackelberg Games

arXiv:2504.09006v5 Announce Type: replace-cross Abstract: We initiate the study of structured Stackelberg games, a novel form of strategic interaction between a leader and a follower where contextual...

By Maria-Florina Balcan, Kiriaki Fragkia, Keegan Harris
arXiv Machine Learning
Sep 1

Adversarial Online Classification with a Preview

arXiv:2608. 29503v1 Announce Type: new Abstract: Worst-case online classification is governed by sequential complexity, such as Littlestone dimension, and can be impossible even for statistically simple classes, such as thresholds of VC dimension one.

By Roi Livni, Sahil Singla