arXiv Statistics ML

Adaptive Replication Strategies in Trust-Region-Based Bayesian Optimization of Stochastic Functions

The paper presents OGPIT, a trust‑region Bayesian optimization method that uses Gaussian process models and adaptive replication to handle stochastic functions with high variance. By allocating repeated evaluations where most beneficial and incorporating cost‑aware acquisition modifications, the approach scales efficiently when many samples are needed to reduce noise. Numerical experiments demonstrate that adaptive replication improves computational efficiency while maintaining solution accuracy compared to baseline methods.

arXiv Machine Learning
Jun 8

LAGO: A Local-Global Optimization Framework Combining Trust Region Methods and Bayesian Optimization

arXiv:2603. 02970v2 Announce Type: replace Abstract: We introduce LAGO, a LocAl-Global Optimization framework coupling Bayesian Optimization (BO) and gradient-based trust region local refinement through an adaptive competition mechanism for smooth expensive-to-evaluate objective functions with available gradients.

By Eliott Van Dieren, Tommaso Vanzan, Fabio Nobile
arXiv Machine Learning
Sep 15

Bayesian Optimisation Using Product-of-Experts Gaussian Process Models with Uncertainty Calibration

The paper introduces BO-pro-c, a Bayesian optimisation algorithm that employs a product-of-experts Gaussian process (GP-pro-c) as its surrogate model. GP-pro-c combines multiple local GP experts to improve uncertainty quantification, reduce computational cost, and preserve global correlations, addressing the cubic complexity of single global GP models. Experiments show that BO-pro-c achieves competitive optimisation performance with a 0.9% lower simple regret and a 39.4% reduction in computational overhead compared to a single‑global‑GP baseline.

By Yean Hoon Ong
arXiv Machine Learning
Sep 25

MF-SCBO : Multi-fidelity Scalable Constrained Bayesian Optimization

MF-SCBO is a new multi‑fidelity extension of Scalable Constrained Bayesian Optimization designed for high‑dimensional black‑box functions with black‑box constraints. It handles an arbitrary number of fidelity levels and non‑nested sampling, addressing gaps in existing methods. Experiments on standard benchmarks and challenging problems show that MF‑SCBO generally converges faster than both single‑fidelity SCBO and other multi‑fidelity approaches in high‑dimensional constrained settings.

By Lucas Palazzolo, Micka\"el Binois, La\"etitia Giraldi