Hugging Face Trending Papers
A Simple and Unified Method for Gradient-Variation Regret
Read the original on Hugging Face Trending Papers →The Flow has not summarised this story yet — read it at Hugging Face Trending Papers.
Related stories
arXiv Machine Learning
Sep 22
Small Gradient Norm Regret for Online Convex Optimization
arXiv:2601.13519v4 Announce Type: replace-cross Abstract: This paper introduces a new problem-dependent regret measure for online convex optimization with smooth losses. The notion, which we call the...
arXiv Machine Learning
Jun 3
Online Learning with Gradient-Variation Interval Regret
arXiv:2606. 03831v1 Announce Type: new Abstract: This paper investigates non-stationary online learning using the metric of interval regret, which requires an online algorithm to perform well over every time interval.
arXiv Machine Learning
Sep 21
From Switching to Dynamic Regret: A Simple Reduction via Unbiased Random Sequences
The paper introduces a straightforward framework that transforms dynamic regret minimization into switching regret minimization by constructing an unbiased random sequence for any comparator sequence. Using this reduction, the authors derive dynamic regret bounds for strongly convex and exp-concave losses of “~O(T^{1/3}P_T^{2/3})” and for general convex losses of “O(√{T(1+P_T)})”, matching known minimax optimal results. The approach leverages off-the-shelf switching regret algorithms and controlled variance to achieve these bounds.
arXiv Machine Learning
Sep 30
Dynamic Regret via Discounted-to-Dynamic Reduction with Applications to Curved Losses and Adam Optimizer
arXiv:2602.08372v2 Announce Type: replace Abstract: We study dynamic regret minimization in non-stationary online learning, with a primary focus on follow-the-regularized-leader (FTRL) methods. FTRL...
arXiv Statistics ML
Oct 26
Strongly Adaptive Online Learning with Time-Varying Movement Costs
arXiv:2610.32740v1 Announce Type: cross Abstract: We study strongly adaptive regret for Online Convex Optimization (OCO) with time-varying movement costs, a setting that evaluates a learner's perform...
arXiv Machine Learning
Aug 18
Online Convex Optimization with Dueling Feedback
arXiv:2608. 15050v1 Announce Type: new Abstract: We study online convex optimization with dueling (pairwise comparison) feedback, where the learner observes only a binary preference between two queried points.