arXiv Machine Learning

A Unified Information-Theoretic Approach to Constrained Multi-Fidelity Multi-Objective Bayesian Optimization

The paper introduces a unified information‑theoretic framework for Bayesian optimization that simultaneously handles multiple objectives, constraints, and fidelity levels. It defines query utility as the information gain about the highest‑fidelity feasible Pareto frontier and derives a tractable variational lower bound using truncated approximations. The resulting cost‑aware acquisition function leverages multi‑fidelity surrogate models, eliminating the need for separate heuristics, and is validated on synthetic, benchmark, and real‑world experiments.

arXiv Machine Learning
Sep 25

MF-SCBO : Multi-fidelity Scalable Constrained Bayesian Optimization

MF-SCBO is a new multi‑fidelity extension of Scalable Constrained Bayesian Optimization designed for high‑dimensional black‑box functions with black‑box constraints. It handles an arbitrary number of fidelity levels and non‑nested sampling, addressing gaps in existing methods. Experiments on standard benchmarks and challenging problems show that MF‑SCBO generally converges faster than both single‑fidelity SCBO and other multi‑fidelity approaches in high‑dimensional constrained settings.

By Lucas Palazzolo, Micka\"el Binois, La\"etitia Giraldi
arXiv AI
Aug 6

Out-Of-The-Loop Multi-Fidelity Bayesian Optimization

arXiv:2608. 04113v1 Announce Type: cross Abstract: Black-box optimization is a ubiquitous problem in science and engineering, often dealing with expensive objective functions with cheaper lower-fidelity proxies available.

By Gustavo Sutter, Hao Wang, Luis Ricardez-Sandoval, Pascal Poupart, Agustinus Kristiadi
arXiv Machine Learning
Jul 7

Local Constrained Bayesian Optimization

arXiv:2603. 07965v2 Announce Type: replace-cross Abstract: Bayesian optimization (BO) for high-dimensional constrained problems remains a significant challenge due to the curse of dimensionality.

By Jing Jingzhe, Fan Zheyi, Szu Hui Ng, Qingpei Hu
arXiv Machine Learning
Aug 28

Active Preference Learning over Latent Preference Archetypes for Many-Objective Bayesian Optimization

The paper introduces an active preference learning framework for many-objective Bayesian optimization that models preferences as a Dirichlet-process mixture of latent archetypes. It uses mixture-aware information-theoretic query strategies to separately identify archetypes and refine preferences within each archetype, employing a hybrid acquisition policy. Experiments on synthetic benchmarks and a real-world chemical process design case study show that this approach outperforms existing preference-based Bayesian optimization methods and recovers interpretable latent preference structures.

By Manisha Dubey, Sebastiaan De Peuter, Wanrong Wang, Samuel Kaski