arXiv Machine Learning

Causal Posterior Estimation

The paper introduces Causal Posterior Estimation (CPE), a new Bayesian inference technique for simulator models where the likelihood is intractable but simulation is easy. CPE uses flow matching to approximate the posterior while embedding the model’s conditional dependencies directly into the neural network architecture. Experiments show that this hard‑coded structure yields highly accurate inference, matching or surpassing current state‑of‑the‑art methods.

arXiv Machine Learning
Sep 29

Mixed neural posterior estimation for simulators with discrete and continuous parameters

The paper extends Neural Posterior Estimation (NPE) to handle simulators whose parameter spaces contain both discrete and continuous dimensions. It introduces an inference network that factorizes the joint posterior into discrete and continuous components, using an autoregressive classifier for the discrete part and a generative model for the continuous part, trained jointly with a single simulation-based objective. A diagnostic tool for assessing calibration of the mixed posterior is also proposed, and the method is shown to produce accurate, calibrated posteriors on toy and real scientific simulators.

By Jan Boelts, Cornelius Schr\"oder, Jonas Beck, Jakob H. Macke, Michael Deistler, Daniel Gedon
arXiv Machine Learning
Sep 4

Causal Foundation Models

Causal Foundation Models (CFMs) are pretrained neural networks designed to estimate causal quantities—such as the average treatment effect—across new datasets using in‑context learning, eliminating the need for bespoke pipelines or model updates. The paper introduces CFMs, reviews foundational concepts in causal inference and machine learning, and provides practical code examples and Jupyter notebooks to illustrate their application.

By Christopher Stith, Hossein Rahmani, Jesse C. Cresswell
arXiv Machine Learning
Aug 31

Joint Bayesian Inference of Graphical Structure and Parameters with a Single Generative Flow Network

The paper introduces JSP-GFN, a Generative Flow Network that jointly infers the structure and parameters of a Bayesian Network. It sequentially generates a directed acyclic graph edge by edge and then samples the corresponding conditional probability parameters once the full structure is known. Experiments on simulated and real data show that JSP‑GFN accurately approximates the joint posterior and outperforms existing methods.

By Tristan Deleu, Mizu Nishikawa-Toomey, Jithendaraa Subramanian, Esmeralda S. Whitammer, Laurent Charlin, Yoshua Bengio
arXiv AI
Jun 3

Causal Preference Elicitation

arXiv:2602. 01483v2 Announce Type: replace-cross Abstract: We propose causal preference elicitation, a Bayesian framework for expert-in-the-loop causal discovery that actively queries local edge relations to concentrate a posterior over directed acyclic graphs (DAGs).

By Edwin V. Bonilla, He Zhao, Daniel M. Steinberg