arXiv Machine Learning

Adaptive and oblivious statistical adversaries are equivalent

The paper resolves a key question in statistical learning under adversarial corruption by showing that sample‑adaptive and sample‑oblivious adversaries are equivalent up to polynomial factors in the sample size for all corruption types. It proves that any algorithm that succeeds against a sample‑oblivious adversary can be transformed into one that succeeds against the corresponding sample‑adaptive adversary by requesting a polynomially larger sample and running the original algorithm on a random subsample. The construction preserves computational efficiency and requires only a simple modification of the algorithm.

arXiv Machine Learning
Jul 9

Is Randomness Necessary for Adaptive Data Analysis?

arXiv:2607. 07085v1 Announce Type: cross Abstract: The Adaptive Data Analysis (ADA) problem formalizes the challenge of preventing false discovery and overfitting when a dataset is repeatedly reused.

By Edith Cohen, Haim Kaplan, Yishay Mansour, Shay Sapir, Uri Stemmer
arXiv Machine Learning
Aug 24

When Clean Data Hurts: Learning with Monotone Corruptions Beyond Binary Classification

The paper investigates learning with monotone adversarial corruptions, extending previous binary classification results to multiclass and partial binary settings. It shows that even a small number of strategically inserted corrupted examples can render a learnable multiclass problem with DS dimension 2 completely unlearnable, and provides matching upper bounds when the adversary’s budget is sublinear. The work also demonstrates that classic error rates remain attainable under bounded or limited‑view adversaries.

By Julian Asilis, Shaddin Dughmi, Chirag Pabbaraju
arXiv Machine Learning
Jun 19

Stabilizing Bandits using Regularization: Precise Regret and A Quantitative Central Limit Theorem

arXiv:2603. 10184v2 Announce Type: replace-cross Abstract: Statistical inference with bandit data presents fundamental challenges owing to adaptive sampling, which violates the independence assumptions underlying classical asymptotic theory.

By Budhaditya Halder, Ishan Sengupta, Koustav Chowdhury, Samya Praharaj, Koulik Khamaru