arXiv Machine Learning

An Efficient Black-Box Reduction from Online Learning to Multicalibration, and a New Route to $\Phi$-Regret Minimization

arXiv:2604. 19592v2 Announce Type: replace Abstract: We give a Gordon-Greenwald-Marks (GGM) style black-box reduction from online learning to online multicalibration.

arXiv Machine Learning
Sep 18

The First-Order Oracle Complexity of Lipschitz Convex Optimization in Nondual Settings

arXiv:2609. 20687v1 Announce Type: cross Abstract: We study first-order black-box convex optimization over an $\ell_p$-ball for objectives Lipschitz in the $\ell_q$-norm, solving in the affirmative the nonsmooth version of the COLT open question (Guz15b) on whether the geometry of a smaller feasible set ($p < q$) can improve convergence rates in convex optimization, and matching prior lower bounds up to logarithmic factors.

By David Mart\'inez-Rubio, Brian Bullins, Crist\'obal Guzm\'an, Mathieu Molina
arXiv Machine Learning
Jun 26

Blackwell Approachability and Gradient Equilibrium are Equivalent

arXiv:2606. 27315v1 Announce Type: new Abstract: Gradient equilibrium (GEQ) is a recently introduced online optimization framework that generalizes first-order stationarity from offline optimization and abstracts problems like online conformal prediction.

By Brian W. Lee, Nika Haghtalab, Michael I. Jordan, Ryan J. Tibshirani
arXiv Machine Learning
Aug 10

Multiscale Reward Hedging from Correct Demonstrations

arXiv:2608. 06825v1 Announce Type: new Abstract: Learning from correct demonstrations is harder than supervised learning when many answers are correct: after predicting, the learner sees one valid answer but not whether its own answer was valid, nor any reward.

By Pahan Dewasurendra
arXiv Machine Learning
1d ago

Sharp Oracle-Regret Tradeoffs for Projection-Free Online Convex Optimization

The paper studies online convex optimization when the learner can only query an exact linear optimization oracle. It establishes a dimension‑free minimax expected regret bound of θ(GD max{√T, T/(1+min{Q,BT})^{1/4}}) for convex G‑Lipschitz losses, where Q is the total oracle budget and B the per‑round limit. The authors provide matching lower and upper bounds, showing how strict per‑round or total‑budget constraints affect the achievable regret, and extend the analysis to smooth losses with curvature‑dependent bounds.

By Vaneet Aggarwal
arXiv AI
Sep 3

Online Non-Monotone DR-Submodular Maximization Matching the Offline $0.401$ Factor

The paper presents an online algorithm that achieves the same $0.401$ approximation factor for maximizing nonnegative, non-monotone DR-submodular functions over compact convex down-closed subsets of the $d$-dimensional unit cube as the best known offline construction. In the full-information value-oracle model, the algorithm attains this factor with sublinear regret, using $O(dT^{1/4})$ oracle calls per round and $O(T^{3/4})$ regret, and offers flexible batching trade-offs. Under a positive-anchor condition, a randomized blocking strategy preserves the $0.401$ factor while achieving $O(T^{5/6})$ one-point bandit regret.

By Vaneet Aggarwal, Yiyang Lu
arXiv Machine Learning
Aug 18

Online Convex Optimization with Dueling Feedback

arXiv:2608. 15050v1 Announce Type: new Abstract: We study online convex optimization with dueling (pairwise comparison) feedback, where the learner observes only a binary preference between two queried points.

By Yiyang Lu, Hareshkumar Jadav, Mohammad Pedramfar, Ranveer Singh, Vaneet Aggarwal