arXiv AI

BayesNDE: Bayesian Generative Modeling for Neural Density Estimation

BayesNDE is a neural density estimator that uses Bayesian generative modeling to estimate densities without relying on invertible networks or Jacobian-determinant calculations. It constructs an adaptive proposal for each observation by inferring a sample-specific latent posterior, and then applies bridge sampling to combine proposal samples with separate posterior samples for density estimation. Experiments on synthetic datasets show improved density estimation and structure recovery, while real-world applications demonstrate better anomaly detection.

arXiv Machine Learning
Aug 11

In-Context Density Estimation for Tabular Data

arXiv:2608. 09348v1 Announce Type: new Abstract: Density estimation underlies many unsupervised tasks on tabular data such as anomaly detection, out-of-distribution detection, and data augmentation.

By Patryk Marsza{\l}ek, Jacek Tabor, Marek \'Smieja
arXiv Statistics ML
Oct 28

Two-sample comparison through additive tree models for density ratios

The paper introduces additive tree models for estimating the density ratio between two distributions, using a novel balancing loss that enables training with supervised learning algorithms such as forward‑stagewise optimization and gradient boosting. The loss also functions as a pseudo‑likelihood, allowing generalized Bayesian inference via backfitting samplers for Bayesian additive regression trees, which provides uncertainty quantification. Experiments show that the boosting algorithms achieve high accuracy with low computational cost, and the Bayesian approach offers competitive accuracy while delivering uncertainty estimates, demonstrated on microbiome compositional data.

By Naoki Awaya, Yuliang Xu, Li Ma
arXiv Machine Learning
Sep 29

Mixed neural posterior estimation for simulators with discrete and continuous parameters

The paper extends Neural Posterior Estimation (NPE) to handle simulators whose parameter spaces contain both discrete and continuous dimensions. It introduces an inference network that factorizes the joint posterior into discrete and continuous components, using an autoregressive classifier for the discrete part and a generative model for the continuous part, trained jointly with a single simulation-based objective. A diagnostic tool for assessing calibration of the mixed posterior is also proposed, and the method is shown to produce accurate, calibrated posteriors on toy and real scientific simulators.

By Jan Boelts, Cornelius Schr\"oder, Jonas Beck, Jakob H. Macke, Michael Deistler, Daniel Gedon
arXiv Machine Learning
Sep 30

High-Dimensional Simulation-Based Inference in Latent Spaces

arXiv:2609.37381v1 Announce Type: new Abstract: Neural simulation-based inference (SBI) has been widely successful in inferring a relatively small number of interpretable parameters from potentially...

By Lars K\"uhmichel, Stefan T. Radev, Bhanu Prasanna Koppolu, Masoumeh Davoudi, Jerry M. Huang, Paul-Christian B\"urkner
arXiv Machine Learning
Aug 27

Generative Modeling: A Review

The paper reviews generative modeling by categorizing generators into three types: those estimating counterfactual outcome distributions in causal inference, those recovering posteriors from simulated parameter–outcome pairs, and those forming predictive outcome distributions. It introduces generative Bayesian computation, a quantile neural network trained on simulated pairs using the pinball loss, which directly targets posterior distributions without requiring invertible architectures or density evaluation. The method is demonstrated on an agent-based Ebola transmission model, showing accurate posterior recovery at lower computational cost than rejection-based simulation inference.

By Maria Nareklishvili, Nick Polson, Vadim Sokolov
arXiv Machine Learning
Oct 16

Classical methods for modern applications: synthetic tabular data generation using lightweight discrete response continuous latent variable model

The paper introduces a lightweight algorithm for modeling tabular data with both continuous and discrete variables. It transforms data into a continuous latent space using empirical marginals and a quantile function, enabling efficient estimation with distributions like a multivariate Gaussian. The method preserves complex marginal distributions and correlations, and handles discrete variables via a Monte Carlo expectation‑maximisation framework that allows conventional maximum‑likelihood estimation.

By Bartosz Barzdajn, Mateusz Krzyszto\'n