arXiv Machine Learning
Aug 13

Linear-Core Surrogates: Smooth Loss Functions with Linear Rates for Classification and Structured Prediction

arXiv:2604. 27742v2 Announce Type: replace Abstract: A fundamental dichotomy in the theory of classification sets smoothness against statistical efficiency: smooth surrogate losses such as the logistic loss enable fast $O(1/T)$ optimization but yield slow square-root $H$-consistency bounds, while piecewise-linear losses like the Hinge loss achieve optimal linear $H$-consistency rates but are non-differentiable.

By Mehryar Mohri, Yutao Zhong
arXiv Machine Learning
Oct 16

BOLT: Universal Classifier Training via a Bayes-Error Upper Bound

The paper presents BOLT, a new loss function that uses a universal upper bound on the Bayes error rate (BER) derived from classifier-output samples. This bound is tight for binary classification and the authors analyze the max‑sum gap in multiclass settings. Experiments on synthetic and real datasets demonstrate that BOLT training can achieve lower held‑out classification error than traditional cross‑entropy training.

By Mohammadreza Tavasoli Naeini, Ali Bereyhi, Morteza Noshad, Ben Liang, Alfred O. Hero III