Hugging Face Trending Papers

Rènyi-Regularized Flow-Based Variational Inference for Bayesian Calibration

Read the original on Hugging Face Trending Papers →

The paper investigates how variational inference using normalizing flows can struggle with multimodal posteriors, particularly when modes are separated by low-probability regions. By adding a Rényi divergence-based regularization term, the authors encourage the approximate posterior to cover the prior support, reducing mode collapse from 50% to 25% in a twin experiment. However, this regularization alters the Bayesian objective and introduces a trade‑off in approximation accuracy, and it does not solve mode collapse in general.

Machine-generated by The Flow from the publisher's headline and feed description — not written or checked by a human. The full article lives at Hugging Face Trending Papers.

arXiv AI
Oct 28

R\`enyi-Regularized Flow-Based Variational Inference for Bayesian Calibration

arXiv:2610. 37169v1 Announce Type: new Abstract: Variational inference with normalizing flows provides a flexible posterior approximation for Bayesian model calibration, but struggles when the posterior has several modes separated by regions of low probability mass.

By Exauc\`e Luweh Adjim Ngarti (AIRSEA), \'Elise Arnaud (AIRSEA), L\'eo Nicoletti (Mines Saint-\'Etienne MSE, LIMOS, FAYOL-ENSMSE, FAYOL-ENSMSE), Victor Trappler (Mines Saint-\'Etienne MSE, LIMOS, FAYOL-ENSMSE, FAYOL-ENSMSE), Arthur Vidard (AIRSEA)
arXiv AI
Oct 31

Amortized Localized Posterior Inference for Model Calibration with Application to an Ocean Turbulence Closure

The paper introduces a method for localized posterior inference that weights observation likelihoods based on proximity to a target context, using Gaussian localization and a conditional normalizing flow for amortized variational inference. By integrating these localized posteriors over a context measure, the authors obtain a marginalized parameter distribution that accounts for observation and context uncertainties. Experiments with the Branin-Hoo model and a k‑ε turbulence closure in an ocean model demonstrate that localization reduces aggregate predictive errors and improves temperature and zonal‑velocity predictions compared to global or deterministic calibration.

By Exauc\'e Luweh Adjim Ngarti (AIRSEA), \'Elise Arnaud (AIRSEA), L\'eo Nicoletti (Mines Saint-\'Etienne MSE, LIMOS, FAYOL-ENSMSE, FAYOL-ENSMSE), Victor Trappler (Mines Saint-\'Etienne MSE, LIMOS, FAYOL-ENSMSE, FAYOL-ENSMSE), Arthur Vidard (AIRSEA)
arXiv Machine Learning
Sep 14

A Generalized Tangent Approximation based Variational Inference Framework for Strongly Super-Gaussian Likelihoods

The paper introduces a new variational inference framework that uses tangent transformations to handle strongly super‑Gaussian likelihoods across a wide range of probability models. By constructing tangent minorants of the log‑likelihood through convex duality, the method achieves conjugacy with Gaussian priors, enabling tractable inference where traditional approaches struggle. The authors provide algorithmic convergence guarantees and near‑parametric risk bounds, and demonstrate superior scalability and accuracy on both simulated and real‑world datasets compared to existing variational algorithms.

By Somjit Roy, Pritam Dey, Debdeep Pati, Bani K. Mallick