arXiv Statistics ML

A Two-step Metropolis Hastings Method for Bayesian Empirical Likelihood Computation with Application to Quantile Regression and Bayesian Model Selection

The paper introduces a two-step Metropolis–Hastings algorithm designed to efficiently sample from Bayesian empirical likelihood (BayesEL) posterior distributions, addressing challenges posed by the complex, often non‑convex support of empirical likelihood. The method leverages current parameter values and estimating equations to propose new values for remaining parameters, making it suitable for problems with discontinuous estimating equations such as simultaneous quantile regression. Additionally, the approach extends naturally to BayesEL model selection via reversible‑jump MCMC, and the authors demonstrate its utility through several real‑life applications.

arXiv Machine Learning
Oct 12

Amortised Inference through One-Step Implicit Sampling

The paper introduces OSIS, a one‑step implicit sampler that uses short‑time MCMC dynamics to define a local target for an implicitly modelled distribution. In the asymptotic limit, the model converges to a fixed point of the MCMC kernel, enabling unbiased sampling from the Bayesian posterior. Experiments show OSIS outperforms multi‑step amortised samplers and non‑amortised MCMC baselines while being far more efficient at sampling time.

By Vincent Pauline, Kirill Tamogashev, Arran Carter, Sanghyeok Choi, Stefan Bauer, Esmeralda S. Whitammer
arXiv Machine Learning
Sep 24

Variance Reduction for Independent Metropolis

arXiv:2406.17699v3 Announce Type: replace-cross Abstract: Assume that we would like to estimate the expected value of a function $F$ with respect to an intractable density $\pi$, which is specified u...

By Siran Liu, Petros Dellaportas, Michalis K. Titsias
arXiv Machine Learning
Oct 12

Product Monte Carlo: Expectation Under a Product of Densities

Product Monte Carlo (PMC) is an algorithm that estimates expectations under a product of densities using only Monte Carlo samples from each individual density. By reformulating the intractable product expectation as a regression problem involving computable conditional expectations, PMC provides both point estimates and coherent Bayesian uncertainty quantification. The method achieves higher accuracy, better-calibrated uncertainty, and improved scalability compared to existing techniques, and it does not require density evaluations, enabling its use in simulation‑based inference such as protein image analysis.

By Pietro Carlotti, Sifan Liu, Yuling Yao
arXiv Machine Learning
3d ago

Conditional Mean Flows: Few-Step Densities for Simulation-Based Inference

Conditional Mean Flows introduce a new approach for simulation-based inference that replaces the costly numerical integration of traditional flow matching with few-step sampling and tractable density evaluation. By identifying conditional flow maps through a mean flow objective and using independent masking, the method allows direct estimation of marginal likelihoods. Experiments demonstrate that single-step conditional mean flow density evaluation achieves error comparable to 200-step flow matching while accelerating downstream MCMC sampling by roughly 200‑fold.

By Jonas Arruda, Jan Hasenauer, Stefan T. Radev
arXiv Machine Learning
Jul 27

Simulation-Based Empirical Bayes

arXiv:2607. 21843v1 Announce Type: cross Abstract: Empirical Bayes (EB) performs simultaneous inference across many related latent variables.

By Xinwei Shen, Diana Cai, Cheng Zhang, David M. Blei