← Back to all news
arXiv Machine Learning By Edvin Ketabati Augustinsson, Robert A. Bridges

No-Regret Bayesian Optimization with Finite-Library Input-Warped Kernels

Read the original on arXiv Machine Learning →

The paper introduces Finite-Library Input-Warped Bayesian Optimization (FLIWBO), a method that selects input warps from a finite library to adapt the geometry used by Gaussian‑process Bayesian optimization. FLIWBO maintains high‑probability convergence guarantees while improving sample efficiency on problems where raw coordinates poorly match the objective’s geometry, such as log‑scaled hyperparameters or localized peaks. Experiments on synthetic benchmarks, Fashion‑MNIST hyperparameter tuning, and a 20‑dimensional multi‑agent system design demonstrate that FLIWBO‑UCB outperforms raw‑coordinate GP‑UCB and other methods with regret guarantees, especially under misspecified geometry.

Machine-generated by The Flow from the publisher's headline and feed description — not written or checked by a human. The full article lives at arXiv Machine Learning.

Related stories

arXiv Machine Learning
Sep 24

tidyHEBO: Robust General-Purpose Bayesian Optimization with Model-Consistent Warping and Pareto Search

tidyHEBO is a BoTorch-native Bayesian optimization tool that jointly applies Yeo-Johnson output warping to a Gaussian‑process surrogate, evaluates acquisition functions on the original objective scale, and conducts constrained cumulative Pareto search across multiple acquisition criteria. Using only default settings, it outperformed other methods on the Olympus benchmark and performed strongly on synthetic, Needle‑in‑a‑Haystack, and Bayesmark tasks, while adaptive batching offered a trade‑off between parallelization and optimization quality. These results position tidyHEBO as a robust, reproducible optimizer suitable for diverse practical problems, including scientific applications and hyperparameter tuning.

By L. A. Zhukov, E. V. Shaburova, D. V. Antonets
benchmarks
More like this →
arXiv Machine Learning
4d ago

LLINBO: Trustworthy LLM-in-the-Loop Bayesian Optimization

LLINBO is a framework that integrates Large Language Models (LLMs) into Bayesian Optimization (BO) by deciding when to use LLM suggestions and when to fall back on classical BO. It introduces three interaction mechanisms, each with a no‑harm theoretical guarantee of sublinear cumulative regret for common kernels, without requiring performance assumptions on the LLM. Experiments show that LLINBO improves the reliability of LLM‑based BO and outperforms classical BO in both simulations and a real‑world 3D printing task.

By Chih-Yu Chang, Milad Azvar, Chinedum Okwudire, Raed Al Kontar
llms
More like this →