arXiv Machine Learning By Aitor Oviedo-Madrid, Mabel Morales-Otero, Jose Gonzalez-Gomariz, Ruben Arma\~nanzas

Semi-Linear Gaussian Bayesian Networks: Enhancing Flexibility in Node Dependencies via penalized B-Splines

Read the original on arXiv Machine Learning →

The paper introduces Semi-Linear Gaussian Bayesian Networks (SLGBN), a new class of continuous Bayesian networks that combine linear Gaussian models with nonlinear conditional mean functions estimated via penalized B-splines within generalized additive models. SLGBN preserves Gaussian conditional distributions while allowing nonlinear relationships, and the authors provide parameter estimation procedures and a greedy hill‑climbing algorithm for structure learning. Experiments comparing SLGBN to semiparametric and linear Gaussian models show that SLGBN achieves better goodness‑of‑fit and structure recovery, especially when using the EBIC* score, while maintaining computational efficiency.

Machine-generated by The Flow from the publisher's headline and feed description — not written or checked by a human. The full article lives at arXiv Machine Learning.

arXiv AI
Oct 28

Dirichlet Process Mixtures within Semiparametric Bayesian Networks: A Novel Conditional Density Estimation Approach

The paper introduces Dirichlet Process Mixtures (DPMs) as a new non‑parametric conditional probability distribution (CPD) model for Semiparametric Bayesian Networks (SPBNs). By replacing kernel density estimators with DPMs, the authors achieve a more compact representation that reduces inference costs and improves density estimation accuracy. Experiments on synthetic and real‑world data show that DPM‑based SPBNs outperform existing SPBNs and other continuous‑variable Bayesian network models in both density estimation and structure learning tasks.

By Victor Alejandre, Pedro Larra\~naga, Concha Bielza
arXiv Machine Learning
Aug 31

Joint Bayesian Inference of Graphical Structure and Parameters with a Single Generative Flow Network

The paper introduces JSP-GFN, a Generative Flow Network that jointly infers the structure and parameters of a Bayesian Network. It sequentially generates a directed acyclic graph edge by edge and then samples the corresponding conditional probability parameters once the full structure is known. Experiments on simulated and real data show that JSP‑GFN accurately approximates the joint posterior and outperforms existing methods.

By Tristan Deleu, Mizu Nishikawa-Toomey, Jithendaraa Subramanian, Esmeralda S. Whitammer, Laurent Charlin, Yoshua Bengio
arXiv AI
Jul 29

Rethinking Likelihood distributions: Student's t Likelihood Boosts Bayesian Neural Network Performance

arXiv:2607. 25376v1 Announce Type: cross Abstract: In Bayesian neural networks (BNNs), variational inference is a widely adopted framework for modeling uncertainty in a distributional way, with the evidence lower bound (ELBO) serving as the standard objective function.

By Pei-Hsuan Hsia, Lars H. Heyen, Arvid Weyrauch, Markus Goetz, Achim Streit, Sebastian Krumscheid, Charlotte Debus