← Back to all news
arXiv Statistics ML By Shogo Iwazaki

Improved Regret Bounds for Gaussian Process Upper Confidence Bound in Bayesian Optimization

Read the original on arXiv Statistics ML →

This paper tackles Bayesian optimization using Gaussian processes, focusing on minimizing regret when the objective function is drawn from a known GP. For a Matérn kernel with sufficient smoothness, the authors prove that the GP-UCB algorithm achieves a cumulative regret of “~O(√T) with high probability. They also establish an “O(√T ln²T)" regret bound for the squared exponential kernel, bridging the gap between previous upper bounds and Scarlett’s 2018 results. The analysis hinges on capturing the concentration of the input sequence generated by GP-UCB to refine the GP’s information‑gain estimates.

Machine-generated by The Flow from the publisher's headline and feed description — not written or checked by a human. The full article lives at arXiv Statistics ML.

Related stories

arXiv Machine Learning
Sep 25

Exact Bayes Regret and Asymptotic Optimality in High-Dimensional Gaussian Bandits

The paper analyzes Bayesian linear bandits with isotropic Gaussian parameters, independent Gaussian arms, and Gaussian reward noise when the time horizon scales with the dimension. It derives explicit limits for the normalized posterior uncertainty and parameter overlaps, yielding exact regret curves for several policies—including Thompson sampling, posterior‑mean greedy selection, and scaled‑covariance variants. The results show that posterior‑mean greedy selection achieves the optimal Bayes regret, while Thompson sampling incurs a strictly larger leading regret whose ratio to greedy lies between one and two, approaching two for long horizons.

By Prakhar Singhvi (Abstract Math Institute), Yi Zou (Abstract Math Institute), Abhishek Bhattacharjee (Abstract Math Institute)
reinforcement-learning
More like this →