arXiv Machine Learning

Robust Experimental Design via Generalised Bayesian Inference

The paper introduces Generalised Bayesian Optimal Experimental Design (GBOED), extending generalised Bayesian inference to experimental design. It replaces the likelihood in Bayesian updates with a loss function, deriving a new acquisition function called Gibbs expected information gain. Empirical results show that GBOED improves robustness against outliers and mis-specified outcome noise distributions.

arXiv Machine Learning
Oct 12

Approximation of differential entropy in Bayesian optimal experimental design

The paper presents a method for approximating differential entropy in Bayesian optimal experimental design, focusing on cases where the likelihood entropy is design‑independent or explicitly computable, such as additive noise models. By reducing the expected information gain to a single integral, the authors propose using Monte Carlo or quasi‑Monte Carlo surrogates for the evidence density while evaluating differential entropy with standard techniques, thereby avoiding extra likelihood evaluations. Theoretical analysis shows convergence rates comparable to or better than existing methods, and numerical experiments support these findings.

By Chuntao Chen, Tapio Helin, Nuutti Hyv\"onen, Yuya Suzuki
arXiv Machine Learning
Jul 21

Deep Adaptive Bayesian Screening

arXiv:2607. 16927v1 Announce Type: cross Abstract: We introduce Deep Adaptive Bayesian Screening (DABS), a method for performing adaptive factorial screening in high-dimensional discrete design spaces.

By Jade Lejeune Herman, Arno Strouwen, Johan A. K. Suykens, Peter Goos
arXiv Machine Learning
Oct 16

Designing Experiments for External Decision Makers

The paper introduces usage‑aware experimental design, a framework that extends standard Bayesian experimental design to settings where external decision makers act on collected data. It trains adaptive design policies to minimise the experimenter’s expected loss under external rules, which may be non‑Bayesian or black‑box. The authors show that more informative data can be harmful under such rules, so usage risk cannot be expressed as expected uncertainty reduction, thereby generalising standard BED.

By Sahel Iqbal, Tom Rainforth
arXiv Machine Learning
Oct 8

Towards Regret Guarantees for One-Step Lookahead Bayesian Optimization

The paper investigates theoretical guarantees for a one‑step lookahead Bayesian optimization method called optimal‑point variance reduction (OVR). It derives a uniform Monte Carlo estimation error bound for the acquisition function and shows that a regularized version of OVR achieves a vanishing Bayesian expected simple regret bound. Numerical experiments validate the performance of both OVR and its regularized variant.

By Shion Takeno