arXiv Statistics ML

The Curvature of Regret in Contextual Linear Optimization

arXiv Machine Learning
Aug 28

Safety by Design: Realized-Cost Constraints for Contextual Bandits with Continuous Actions

The paper introduces a new approach to safety in contextual bandits with continuous actions, focusing on high‑probability constraints on the realized cost rather than expected cost. It presents the High‑Probability Constrained UCB algorithm, which balances reward exploration with conservative safety estimation, and provides theoretical regret guarantees for linear models and extensions to general function classes. Experiments demonstrate that this realized‑cost safety framework significantly reduces safety violations compared to expected‑cost constrained methods.

By Spyros Dragazis, Aldo Pacchiano
arXiv Machine Learning
Jul 22

Optimizing Regret

arXiv:2607. 18866v1 Announce Type: cross Abstract: Building on the identity that expected regret equals the covariance between costs and decisions, this paper develops the complete derivative theory of the covariance regret functional.

By Irene Aldridge
Hugging Face Trending Papers
Aug 27

Safety by Design: Realized-Cost Constraints for Contextual Bandits with Continuous Actions

The paper introduces a new approach to safety in contextual bandits with continuous actions by enforcing high‑probability constraints on the realized cost rather than on its expectation. It proposes the High‑Probability Constrained UCB algorithm, which balances optimistic reward exploration with pessimistic safety estimation. The authors provide theoretical regret guarantees for linear models and extend the analysis to general function classes, demonstrating experimentally that realized‑cost constraints significantly reduce safety violations compared to expected‑cost baselines.

Hugging Face Trending Papers
Jul 21

Optimizing Regret

Building on the identity that expected regret equals the covariance between costs and decisions, this paper develops the complete derivative theory of the covariance regret functional. We derive the Gâteaux derivative, showing that the universal steepest-descent direction is the contrarian policy $-(c-\bar{c})$, while ascent yields momentum.