arXiv Machine Learning By Tim Weiland, Toni Karvonen, Philipp Hennig

Hierarchical Bayesian Quadrature

Read the original on arXiv Machine Learning →

arXiv:2607. 10793v1 Announce Type: new Abstract: Numerical integration is a cornerstone of various scientific computing applications, such as engineering simulations and model evidence computations in probabilistic machine learning.

Machine-generated by The Flow from the publisher's headline and feed description — not written or checked by a human. The full article lives at arXiv Machine Learning.

arXiv Machine Learning
Sep 17

Bayesian Quadrature

This survey article reviews Bayesian quadrature, a probabilistic, model‑based method for numerical integration and expectation estimation. It provides a systematic taxonomy of Bayesian quadrature techniques across modelling, inference, and sampling, presents theoretical guarantees, and includes a controlled numerical study illustrating the impact of different methodological choices. The paper also discusses practical challenges, limitations, and offers an extensive bibliography covering machine learning, statistics, mathematics, and engineering applications.

By Maren Mahsereci, Toni Karvonen
arXiv Machine Learning
Sep 24

Dirichlet Process Mixtures of Trees with Gaussian Process Splits: A Bayesian Nonparametric Framework with Posterior Contraction Rate

arXiv:2609. 27930v1 Announce Type: cross Abstract: We propose a Bayesian nonparametric mixture of regression trees with a Dirichlet process prior over tree-parameter pairs, enabling data-driven selection of ensemble size and unifying CART, BART, random forests, and boosting.

By Subhasish Basak, Anik Roy, Sourabh Bhattacharya
arXiv Machine Learning
Aug 24

Exact and general decoupled solutions of the LMC Multitask Gaussian Process model

The paper presents an exact, efficient solution for the Linear Model of Co‑regionalization (LMC) multitask Gaussian Process by decoupling latent processes under a mild noise‑model assumption. It introduces a full parametrization of the resulting projected LMC, enabling linear‑time optimization and simplifying tasks such as training updates and leave‑one‑out cross‑validation. Experiments on synthetic and real data demonstrate that projected LMC is competitive with state‑of‑the‑art multitask GP models while offering greater interpretability and computational ease.

By Olivier Truffinet (CEA Saclay), Karim Ammar (CEA Saclay), Jean-Philippe Argaud (EDF R&D), Bertrand Bouriquet (EDF)
arXiv Statistics ML
Sep 3

Robust Bayesian Inference for Unnormalized Models with Mixed-Domain Data

The paper introduces SME-BETEL, a semiparametric Bayesian method that merges score matching estimating equations with Bayesian exponentially tilted empirical likelihood to perform inference on models with intractable normalizing constants. SME-BETEL avoids evaluating these constants and eliminates the need for learning-rate calibration, while providing consistency, asymptotic normality, and a Bernstein‑von Mises theorem that guarantees asymptotically calibrated credible sets even under model misspecification. The authors extend the framework to mixed‑domain data, enabling robust inference for doubly‑intractable models such as spatial preferential sampling, and demonstrate its effectiveness through simulations and an ozone‑monitoring application.

By Jiongran Wang, Debdeep Pati, Anirban Bhattacharya