Hugging Face Trending Papers

Shrinkage prior for implicit generative models

arXiv Machine Learning
Jun 15

Implicit Variational Rejection Sampling

arXiv:2606. 14235v1 Announce Type: new Abstract: Variational Inference (VI) is a fundamental inference technique in Bayesian machine learning for approximating complex posterior distributions.

By Jian Xu, Shigui Li, Wei Chen, Jiacheng Li, Zhiqi Lin, Delu Zeng, Xinghao Ding, John Paisley, Qibin Zhao
arXiv AI
Oct 1

BayesNDE: Bayesian Generative Modeling for Neural Density Estimation

BayesNDE is a neural density estimator that uses Bayesian generative modeling to estimate densities without relying on invertible networks or Jacobian-determinant calculations. It constructs an adaptive proposal for each observation by inferring a sample-specific latent posterior, and then applies bridge sampling to combine proposal samples with separate posterior samples for density estimation. Experiments on synthetic datasets show improved density estimation and structure recovery, while real-world applications demonstrate better anomaly detection.

By Chenglin Li, Qiao Liu
arXiv Machine Learning
Jun 18

Structured Inference with Large Language Gibbs

arXiv:2606. 19264v1 Announce Type: new Abstract: The knowledge encoded in large language models (LLMs) can serve as a substrate for structured reasoning over variables describing a complex world, but accessing this knowledge in a probabilistically coherent manner poses a difficult inference problem.

By Sanghyeok Choi, Henry Gouk, Esmeralda S. Whitammer
arXiv Statistics ML
Oct 19

Empowering Bayes with sources of uncertainty: from confidence modelling to sparse estimation

The paper introduces Sources of Uncertainty (SoU) inference, a framework that extends Bayesian inference by allowing heterogeneous confidence to be encoded across model components. This selective treatment controls the uncertainty retained in each component and its propagation, yielding Empirical Bayes and profiling-type inference as special cases. The authors also present a general method for inducing sparsity, demonstrating its application in linear and logistic regression and in Bayesian neural networks for self‑pruning.

By Rafael Mouallem Rosa, Julyan Arbel, Hien Duy Nguyen
arXiv Machine Learning
Aug 31

Prequential posteriors

The paper introduces prequential posteriors, a Bayesian approach that uses a predictive‑sequential loss function to update deep generative forecasting models (DGFMs) when new data arrive. By adopting a consistency notion suitable for model misspecification, the authors prove that both the loss minimizer and the posterior concentrate on parameters with optimal predictive performance. Scalable inference is achieved with parallelisable waste‑free sequential Monte Carlo samplers that employ preconditioned gradient kernels, and the method is validated on synthetic and real meteorological time‑series data.

By Shreya Sinha-Roy, Richard G. Everitt, Christian P. Robert, Ritabrata Dutta
arXiv Machine Learning
Sep 30

High-Dimensional Simulation-Based Inference in Latent Spaces

arXiv:2609.37381v1 Announce Type: new Abstract: Neural simulation-based inference (SBI) has been widely successful in inferring a relatively small number of interpretable parameters from potentially...

By Lars K\"uhmichel, Stefan T. Radev, Bhanu Prasanna Koppolu, Masoumeh Davoudi, Jerry M. Huang, Paul-Christian B\"urkner
arXiv Machine Learning
Sep 11

Particle GFlowNets: Rethinking Generative Marginalization Models

The paper introduces Particle GFlowNets, showing that Generative Marginalization Models (MaMs) are equivalent to Generative Flow Networks. It extends MaMs to non‑autoregressive sampling and proposes an automatic full‑state rejuvenation criterion based on the Gelman‑Rubin statistic to accelerate learning. Experiments demonstrate significant training speedups in large combinatorial spaces.

By Tiago da Silva, Diego Mesquita, Salem Lahlou
arXiv AI
Oct 21

PALATE: Peculiar Application of the Law of Total Expectation to Enhance the Evaluation of Deep Generative Models

PALATE is a new framework that improves the evaluation of deep generative models by applying the law of total expectation to accessible data. It builds on the Feature Likelihood Divergence (FLD) method but overcomes FLD’s computational limits, integrating with the MMD baseline metric and the DINOv3 feature extractor. Experiments show PALATE matches or surpasses state‑of‑the‑art methods while being more efficient and scalable, especially for detecting memorization and assessing generalization.

By Tadeusz Dziarmaga, Marcin K\k{a}dzio{\l}ka, Laura Musio{\l}, Patryk Marsza{\l}ek, Artur Kasymov, Piotr Ko\'scielniak, Marcin Mazur