arXiv AI

BayesNDE: Bayesian Generative Modeling for Neural Density Estimation

BayesNDE is a neural density estimator that uses Bayesian generative modeling to estimate densities without relying on invertible networks or Jacobian-determinant calculations. It constructs an adaptive proposal for each observation by inferring a sample-specific latent posterior, and then applies bridge sampling to combine proposal samples with separate posterior samples for density estimation. Experiments on synthetic datasets show improved density estimation and structure recovery, while real-world applications demonstrate better anomaly detection.

arXiv Machine Learning
Aug 11

In-Context Density Estimation for Tabular Data

arXiv:2608. 09348v1 Announce Type: new Abstract: Density estimation underlies many unsupervised tasks on tabular data such as anomaly detection, out-of-distribution detection, and data augmentation.

By Patryk Marsza{\l}ek, Jacek Tabor, Marek \'Smieja
arXiv Machine Learning
2d ago

Mixed neural posterior estimation for simulators with discrete and continuous parameters

The paper extends Neural Posterior Estimation (NPE) to handle simulators whose parameter spaces contain both discrete and continuous dimensions. It introduces an inference network that factorizes the joint posterior into discrete and continuous components, using an autoregressive classifier for the discrete part and a generative model for the continuous part, trained jointly with a single simulation-based objective. A diagnostic tool for assessing calibration of the mixed posterior is also proposed, and the method is shown to produce accurate, calibrated posteriors on toy and real scientific simulators.

By Jan Boelts, Cornelius Schr\"oder, Jonas Beck, Jakob H. Macke, Michael Deistler, Daniel Gedon
arXiv Machine Learning
1d ago

High-Dimensional Simulation-Based Inference in Latent Spaces

arXiv:2609.37381v1 Announce Type: new Abstract: Neural simulation-based inference (SBI) has been widely successful in inferring a relatively small number of interpretable parameters from potentially...

By Lars K\"uhmichel, Stefan T. Radev, Bhanu Prasanna Koppolu, Masoumeh Davoudi, Jerry M. Huang, Paul-Christian B\"urkner
arXiv Machine Learning
Aug 27

Generative Modeling: A Review

The paper reviews generative modeling by categorizing generators into three types: those estimating counterfactual outcome distributions in causal inference, those recovering posteriors from simulated parameter–outcome pairs, and those forming predictive outcome distributions. It introduces generative Bayesian computation, a quantile neural network trained on simulated pairs using the pinball loss, which directly targets posterior distributions without requiring invertible architectures or density evaluation. The method is demonstrated on an agent-based Ebola transmission model, showing accurate posterior recovery at lower computational cost than rejection-based simulation inference.

By Maria Nareklishvili, Nick Polson, Vadim Sokolov
arXiv Machine Learning
Jun 15

Implicit Variational Rejection Sampling

arXiv:2606. 14235v1 Announce Type: new Abstract: Variational Inference (VI) is a fundamental inference technique in Bayesian machine learning for approximating complex posterior distributions.

By Jian Xu, Shigui Li, Wei Chen, Jiacheng Li, Zhiqi Lin, Delu Zeng, Xinghao Ding, John Paisley, Qibin Zhao
arXiv AI
Jul 20

Energy-based Transport for Amortized Bayesian Inference

arXiv:2605. 15407v3 Announce Type: replace-cross Abstract: We consider amortized Bayesian inference for nonlinear inverse problems using only samples from the joint distribution of parameters and observations, including problems with unknown functions in a Banach space.

By Ricardo Baptista, Hojjat Kaveh, Andrew M. Stuart