arXiv Machine Learning By Ajith Anil Meera, Wouter Kouw

Curvature-aware Expected Free Energy as an Acquisition Function for Bayesian Optimization

Read the original on arXiv Machine Learning →

The paper introduces a curvature‑aware Expected Free Energy (EFE) acquisition function for Bayesian optimization, designed to jointly learn and optimize an underlying function. It demonstrates that, under certain assumptions, EFE reduces to familiar criteria such as Upper Confidence Bound, Lower Confidence Bound, and Expected Information Gain, and provides unbiased convergence guarantees for concave functions. Empirical results on a Van der Pol oscillator system identification task and a two‑dimensional oscillatory benchmark show that the adaptive EFE achieves competitive performance in both regret and mean squared error, outperforming typical acquisition functions that excel in only one metric.

Machine-generated by The Flow from the publisher's headline and feed description — not written or checked by a human. The full article lives at arXiv Machine Learning.

arXiv Machine Learning
Jun 2

Local Preferential Bayesian Optimization

arXiv:2606. 02351v1 Announce Type: new Abstract: Bayesian optimization (BO) is a popular and effective approach for tuning expensive, noisy experiments, but requires the formulation of an explicit objective function.

By Johanna Menn, Miriam Kober, Paul Brunzema, David Stenger, Sebastian Trimpe
arXiv Machine Learning
Jun 8

$\alpha$-PFN: Fast Entropy Search via In-Context Learning

arXiv:2606. 07134v1 Announce Type: new Abstract: Information-theoretic acquisition functions such as Entropy Search (ES) offer a principled exploration-exploitation framework for Bayesian optimization (BO).

By Herilalaina Rakotoarison, Steven Adriaensen, Tom Viering, Carl Hvarfner, Samuel M\"uller, Frank Hutter, Eytan Bakshy
arXiv Machine Learning
Sep 15

Bridging Control, Inference, Transport, and Thermodynamics: From Theory to Applications in Learning

The review explores how control theory, optimal transport, probabilistic inference, non‑equilibrium thermodynamics, and machine learning are interconnected through the optimization of free‑energy‑like functionals under dynamical or statistical constraints. It presents a conceptual thread linking these five fields and illustrates the ideas with applications in reinforcement learning, variational inference, and generative modeling. The article is written for readers without prior familiarity, beginning with physics principles.

By Emmy Blumenthal, Nikolas Claussen, Benjamin Eysenbach, Catherine Ji, Gautam Reddy, Colin Scheibner, Benjamin Sorkin