arXiv Machine Learning By Maria B{\aa}nkestad, Sanna Jarl, Jens Sj\"olund

Boundary Variance Inflation Causes Acquisition Bias in Gaussian Processes

Read the original on arXiv Machine Learning →

arXiv:2606. 07561v1 Announce Type: new Abstract: Gaussian processes with stationary kernels on bounded domains exhibit inflated posterior variance near the boundary.

Machine-generated by The Flow from the publisher's headline and feed description — not written or checked by a human. The full article lives at arXiv Machine Learning.

arXiv Machine Learning
Sep 17

Correcting Boundary Bias and Observation Independence in Bayesian Experimental Design

The paper tackles two shortcomings of Gaussian‑process based active learning: (1) the posterior variance is independent of observed values, reducing sensitivity to data structure, and (2) it over‑inflates variance near domain boundaries, causing excessive edge sampling. The authors propose a reconstruction‑driven design density that warps sampling toward regions where the posterior mean changes rapidly, and a geometric equalizer that corrects boundary bias. Experiments on sixteen synthetic and two real‑data benchmarks show that the equalizer consistently improves function reconstruction, while the warp further enhances performance by concentrating measurements where the target function varies most.

By Sanna Jarl, Jens Sj\"olund, Jonathan J. S. Scragg, Maria B{\aa}nkestad
arXiv Machine Learning
Sep 4

No-Regret Bayesian Optimization with Finite-Library Input-Warped Kernels

The paper introduces Finite-Library Input-Warped Bayesian Optimization (FLIWBO), a method that selects input warps from a finite library to adapt the geometry used by Gaussian‑process Bayesian optimization. FLIWBO maintains high‑probability convergence guarantees while improving sample efficiency on problems where raw coordinates poorly match the objective’s geometry, such as log‑scaled hyperparameters or localized peaks. Experiments on synthetic benchmarks, Fashion‑MNIST hyperparameter tuning, and a 20‑dimensional multi‑agent system design demonstrate that FLIWBO‑UCB outperforms raw‑coordinate GP‑UCB and other methods with regret guarantees, especially under misspecified geometry.

By Edvin Ketabati Augustinsson, Robert A. Bridges
arXiv Machine Learning
Sep 18

Online Adaptive Kernel Mixing for Gaussian Process Decision Making

The paper introduces HACK GPs, a method that treats kernel selection for Gaussian Processes as an online learning problem with expert advice. Each candidate kernel is viewed as a GP expert, and a distribution over these experts is updated online using AdaHedge based on a loss that reflects both function fit and task alignment. Two variants—Mixture of Gaussians and categorical sampling—are presented, with theoretical guarantees that the weight concentrates on the best kernel under a loss‑gap condition, and empirical results show robust performance across Bayesian optimization, level set estimation, and Bayesian active learning compared to standard kernels and simple ensembles.

By Kavin Aravindan, Mani Tej Sriram, Gautam Dasarathy, Tejas Bodas