Hugging Face Trending Papers

Rènyi-Regularized Flow-Based Variational Inference for Bayesian Calibration

The paper investigates how variational inference using normalizing flows can struggle with multimodal posteriors, particularly when modes are separated by low-probability regions. By adding a Rényi divergence-based regularization term, the authors encourage the approximate posterior to cover the prior support, reducing mode collapse from 50% to 25% in a twin experiment. However, this regularization alters the Bayesian objective and introduces a trade‑off in approximation accuracy, and it does not solve mode collapse in general.

arXiv AI
Oct 28

R\`enyi-Regularized Flow-Based Variational Inference for Bayesian Calibration

arXiv:2610. 37169v1 Announce Type: new Abstract: Variational inference with normalizing flows provides a flexible posterior approximation for Bayesian model calibration, but struggles when the posterior has several modes separated by regions of low probability mass.

By Exauc\`e Luweh Adjim Ngarti (AIRSEA), \'Elise Arnaud (AIRSEA), L\'eo Nicoletti (Mines Saint-\'Etienne MSE, LIMOS, FAYOL-ENSMSE, FAYOL-ENSMSE), Victor Trappler (Mines Saint-\'Etienne MSE, LIMOS, FAYOL-ENSMSE, FAYOL-ENSMSE), Arthur Vidard (AIRSEA)
arXiv AI
Oct 31

Amortized Localized Posterior Inference for Model Calibration with Application to an Ocean Turbulence Closure

The paper introduces a method for localized posterior inference that weights observation likelihoods based on proximity to a target context, using Gaussian localization and a conditional normalizing flow for amortized variational inference. By integrating these localized posteriors over a context measure, the authors obtain a marginalized parameter distribution that accounts for observation and context uncertainties. Experiments with the Branin-Hoo model and a k‑ε turbulence closure in an ocean model demonstrate that localization reduces aggregate predictive errors and improves temperature and zonal‑velocity predictions compared to global or deterministic calibration.

By Exauc\'e Luweh Adjim Ngarti (AIRSEA), \'Elise Arnaud (AIRSEA), L\'eo Nicoletti (Mines Saint-\'Etienne MSE, LIMOS, FAYOL-ENSMSE, FAYOL-ENSMSE), Victor Trappler (Mines Saint-\'Etienne MSE, LIMOS, FAYOL-ENSMSE, FAYOL-ENSMSE), Arthur Vidard (AIRSEA)
arXiv Machine Learning
Sep 14

A Generalized Tangent Approximation based Variational Inference Framework for Strongly Super-Gaussian Likelihoods

The paper introduces a new variational inference framework that uses tangent transformations to handle strongly super‑Gaussian likelihoods across a wide range of probability models. By constructing tangent minorants of the log‑likelihood through convex duality, the method achieves conjugacy with Gaussian priors, enabling tractable inference where traditional approaches struggle. The authors provide algorithmic convergence guarantees and near‑parametric risk bounds, and demonstrate superior scalability and accuracy on both simulated and real‑world datasets compared to existing variational algorithms.

By Somjit Roy, Pritam Dey, Debdeep Pati, Bani K. Mallick
arXiv Machine Learning
Sep 3

Neural Variational Cut Posteriors without Upstream Data

The paper introduces NeVI‑Cut, a modular variational inference method for cut‑Bayes that does not require access to upstream data or models. It approximates the cut‑posterior by minimizing the expected downstream conditional Kullback‑Leibler divergence, using conditional normalizing flows as the variational family. The authors provide fixed‑data convergence rates, establish uniform KL approximation results for flow classes, and demonstrate the algorithm’s speed and accuracy on several applications.

By Jiafang Song, Sandipan Pramanik, Abhirup Datta
arXiv Machine Learning
Oct 8

Twist Flow for Inverse Problems

arXiv:2610. 09281v1 Announce Type: new Abstract: In Bayesian inverse problems, posterior sampling requires generating samples that are consistent with given observations while capturing the range of plausible solutions.

By Shiqin Zeng, Zijun Deng, Felix J. Herrmann
arXiv Machine Learning
Oct 16

Latent Annealed Posterior Sampling with a Variance-Preserving Bridge for Sparsely Observed Random Fields

The paper introduces Latent Annealed Posterior Sampling (LAPS), a method that maps sparsely observed random fields into a lower‑dimensional latent space and performs posterior sampling there. A variance‑preserving bridge controls local covariance inflation, while flow matching learns the latent prior. Experiments on Gaussian benchmarks, a bimodal posterior, and a Navier‑Stokes field show that LAPS accurately approximates posterior distributions, preserves multiple modes, and keeps conditional sampling costs nearly constant as spatial resolution increases.

By Jiankun Lei, Tian Qi