arXiv Machine Learning

Adversarial Online Classification with a Preview

arXiv:2608. 29503v1 Announce Type: new Abstract: Worst-case online classification is governed by sequential complexity, such as Littlestone dimension, and can be impossible even for statistically simple classes, such as thresholds of VC dimension one.

Hugging Face Trending Papers
Aug 13

Bagging Robustly Learns VC Classes with Linear Sample Complexity

We revisit the problem of learning predictors robust to adversarial examples at test-time. We prove that VC classes are adversarially robustly learnable with sample complexity linear in the VC dimension $d$, providing an exponential improvement over the previous upper bound of Montasser, Hanneke, and Srebro (2019).

arXiv Machine Learning
Aug 24

When Clean Data Hurts: Learning with Monotone Corruptions Beyond Binary Classification

The paper investigates learning with monotone adversarial corruptions, extending previous binary classification results to multiclass and partial binary settings. It shows that even a small number of strategically inserted corrupted examples can render a learnable multiclass problem with DS dimension 2 completely unlearnable, and provides matching upper bounds when the adversary’s budget is sublinear. The work also demonstrates that classic error rates remain attainable under bounded or limited‑view adversaries.

By Julian Asilis, Shaddin Dughmi, Chirag Pabbaraju
arXiv Machine Learning
Oct 19

No-Regret Language Generation

The paper introduces the concept of no‑regret language generation, requiring a generator to make a sublinear number of mistakes across all demonstration sequences and compatible target languages. It presents both a realizable and an agnostic variant, using tree‑based mistake‑forcing dimensions to characterize finite‑horizon minimax complexity and establish necessary and sufficient conditions for no‑regret generation. The authors also connect generation complexity to online prediction, providing optimal mistake bounds for language classes with finite Littlestone dimension.

By Jiaxun Li, Vinod Raman, Ambuj Tewari