arXiv Machine Learning

Fundamental limits of distributed multiclass classification from simple binary decisions

arXiv:2607. 19334v1 Announce Type: cross Abstract: We consider the problem of constructing a $K$-class classifier from the combination of $O(\log K)$ simple binary classifiers -- this is a natural paradigm to construct a sophisticated classifier in a distributed manner with each agent performing a relatively straightforward task.

arXiv Machine Learning
Sep 21

Extreme classification: beating chance with one training example from each class

arXiv:2609. 20897v1 Announce Type: cross Abstract: We study a minimal classification problem: Given independent labeled observations $X\sim P$ and $Z\sim Q$ from two unknown distributions $P,Q$, and given an independent target $Y$ drawn with equal probability from $P$ or $Q$, can one classify $Y$ strictly better than chance whenever $P\neq Q$?

By Kevin Bleakley (LMO, CELESTE), Aaditya Ramdas
arXiv Machine Learning
Jun 5

How abundant are good interpolators?

arXiv:2606. 06469v1 Announce Type: cross Abstract: Let $S$ be the set of unit norm linear classifiers $\theta \in \mathbb{R}^d$ which correctly classify every point of a labeled dataset $(X_i,y_i)_{i=1}^n$, $X_i \in \mathbb{R}^d$, $y_i \in \{-1,+1\}$, with a possibly negative margin $\kappa$ fixed in advance.

By August Y. Chen, Ahmed El Alaoui
arXiv Machine Learning
Sep 17

Reliable learning in challenging environments

The paper addresses the challenge of creating machine learning learners that can guarantee provably correct predictions in difficult test-time scenarios, such as adversarial attacks and natural distribution shifts. It introduces a reliable learner with optimal theoretical guarantees for these settings and discusses practical implementations. The authors demonstrate strong performance on examples like linear separators under log-concave distributions and smooth boundary classifiers under smooth probability distributions.

By Maria-Florina Balcan, Steve Hanneke, Rattana Pukdee, Dravyansh Sharma