arXiv AI By Victor Alejandre, Pedro Larra\~naga, Concha Bielza

Dirichlet Process Mixtures within Semiparametric Bayesian Networks: A Novel Conditional Density Estimation Approach

Read the original on arXiv AI →

The paper introduces Dirichlet Process Mixtures (DPMs) as a new non‑parametric conditional probability distribution (CPD) model for Semiparametric Bayesian Networks (SPBNs). By replacing kernel density estimators with DPMs, the authors achieve a more compact representation that reduces inference costs and improves density estimation accuracy. Experiments on synthetic and real‑world data show that DPM‑based SPBNs outperform existing SPBNs and other continuous‑variable Bayesian network models in both density estimation and structure learning tasks.

Machine-generated by The Flow from the publisher's headline and feed description — not written or checked by a human. The full article lives at arXiv AI.

arXiv Machine Learning
Jun 19

Variational Consensus Monte Carlo for Bayesian Mixture

arXiv:2606. 19643v1 Announce Type: cross Abstract: Motivated by the privacy, sensitivity and sharing limitations of health data, we present a comprehensive pipeline for inference of Bayesian mixture models within a federated learning setting, i.

By Julie Fendler, Francesca L. Crowe, Tom Marshall, Sylvia Richardson, Paul D. W. Kirk
arXiv Machine Learning
Oct 12

Product Monte Carlo: Expectation Under a Product of Densities

Product Monte Carlo (PMC) is an algorithm that estimates expectations under a product of densities using only Monte Carlo samples from each individual density. By reformulating the intractable product expectation as a regression problem involving computable conditional expectations, PMC provides both point estimates and coherent Bayesian uncertainty quantification. The method achieves higher accuracy, better-calibrated uncertainty, and improved scalability compared to existing techniques, and it does not require density evaluations, enabling its use in simulation‑based inference such as protein image analysis.

By Pietro Carlotti, Sifan Liu, Yuling Yao
arXiv Machine Learning
Oct 23

Semi-Linear Gaussian Bayesian Networks: Enhancing Flexibility in Node Dependencies via penalized B-Splines

The paper introduces Semi-Linear Gaussian Bayesian Networks (SLGBN), a new class of continuous Bayesian networks that combine linear Gaussian models with nonlinear conditional mean functions estimated via penalized B-splines within generalized additive models. SLGBN preserves Gaussian conditional distributions while allowing nonlinear relationships, and the authors provide parameter estimation procedures and a greedy hill‑climbing algorithm for structure learning. Experiments comparing SLGBN to semiparametric and linear Gaussian models show that SLGBN achieves better goodness‑of‑fit and structure recovery, especially when using the EBIC* score, while maintaining computational efficiency.

By Aitor Oviedo-Madrid, Mabel Morales-Otero, Jose Gonzalez-Gomariz, Ruben Arma\~nanzas
arXiv Statistics ML
Oct 28

Two-sample comparison through additive tree models for density ratios

The paper introduces additive tree models for estimating the density ratio between two distributions, using a novel balancing loss that enables training with supervised learning algorithms such as forward‑stagewise optimization and gradient boosting. The loss also functions as a pseudo‑likelihood, allowing generalized Bayesian inference via backfitting samplers for Bayesian additive regression trees, which provides uncertainty quantification. Experiments show that the boosting algorithms achieve high accuracy with low computational cost, and the Bayesian approach offers competitive accuracy while delivering uncertainty estimates, demonstrated on microbiome compositional data.

By Naoki Awaya, Yuliang Xu, Li Ma