arXiv Machine Learning

Work While They Sleep: Exploiting Evaluation Latency for Fully Bayesian Optimization

arXiv Machine Learning
Aug 3

Frugal Bayesian Optimization: Scalable Surrogates for Data- and Resource-Limited Discovery

arXiv:2607. 29225v1 Announce Type: new Abstract: Bayesian Optimization (BO) is widely adopted for data-efficient optimization in scientific and engineering applications, yet its computational cost is rarely evaluated alongside optimization performance.

By Panagiotis Krokidas, Christoforos Rekatsinas, Vassilis Sioros, Grigorios M. Chatziathanasiou, Efi-Maria Papia, George Giannakopoulos
arXiv Machine Learning
Sep 24

tidyHEBO: Robust General-Purpose Bayesian Optimization with Model-Consistent Warping and Pareto Search

tidyHEBO is a BoTorch-native Bayesian optimization tool that jointly applies Yeo-Johnson output warping to a Gaussian‑process surrogate, evaluates acquisition functions on the original objective scale, and conducts constrained cumulative Pareto search across multiple acquisition criteria. Using only default settings, it outperformed other methods on the Olympus benchmark and performed strongly on synthetic, Needle‑in‑a‑Haystack, and Bayesmark tasks, while adaptive batching offered a trade‑off between parallelization and optimization quality. These results position tidyHEBO as a robust, reproducible optimizer suitable for diverse practical problems, including scientific applications and hyperparameter tuning.

By L. A. Zhukov, E. V. Shaburova, D. V. Antonets
arXiv Machine Learning
Sep 25

Time-Varying Bayesian Optimization Without a Metronome

Time‑Varying Bayesian Optimization (TVBO) is a framework for optimizing expensive, noisy black‑box functions that change over time. Existing TVBO algorithms assume observations are taken at a constant frequency, an assumption that becomes unrealistic as Gaussian‑process inference scales with the cube of dataset size. This paper relaxes that assumption, derives the first upper regret bound that incorporates variable sampling frequency, and uses the analysis to give practical guidance on dataset sizes and stale‑data policies. An algorithm (BOLT) that follows these recommendations outperforms the current state‑of‑the‑art TVBO methods on both synthetic and real‑world experiments.

By Anthony Bardou, Patrick Thiran
arXiv Statistics ML
Oct 2

IQS-BO: In-Context Query Selection for Bayesian Optimisation

IQS-BO introduces an in‑context query selection method for Bayesian optimisation that learns to choose evaluation points via supervised learning on synthetic priors. The approach uses a Prior‑data Fitted Network (PFN) to predict, in a single forward pass, the probability that each candidate maximises the objective, thereby amortising the decision step and eliminating the need for costly surrogate refitting or acquisition maximisation. Experiments show that IQS‑BO matches or surpasses traditional Gaussian‑process‑based BO and other in‑context methods on both synthetic and real‑world benchmarks, and that a mixture prior combining GP samples with challenging function types further improves performance.

By Luca Geminiani, Nadja Klein