arXiv Statistics ML

Generalised Robust Bayes for Joint Inference of Model and Contamination

The paper introduces H"older--Bayes, a robust generalised Bayesian framework that jointly infers model parameters and the proportion of contamination without specifying an outlier distribution. By applying the H"older divergence to a scaled model, each posterior draw identifies observations least compatible with the fitted model, and averaging these selections propagates uncertainty to outlier‑detection scores. The authors provide theoretical guarantees—including uniform boundedness of the posterior influence function, an $n^{-1/2}$ bound on posterior‑averaged excess risk, and a Bernstein–von Mises theorem—while also demonstrating practical performance through simulations and real‑data experiments.

arXiv Statistics ML
Sep 3

Robust Bayesian Inference for Unnormalized Models with Mixed-Domain Data

The paper introduces SME-BETEL, a semiparametric Bayesian method that merges score matching estimating equations with Bayesian exponentially tilted empirical likelihood to perform inference on models with intractable normalizing constants. SME-BETEL avoids evaluating these constants and eliminates the need for learning-rate calibration, while providing consistency, asymptotic normality, and a Bernstein‑von Mises theorem that guarantees asymptotically calibrated credible sets even under model misspecification. The authors extend the framework to mixed‑domain data, enabling robust inference for doubly‑intractable models such as spatial preferential sampling, and demonstrate its effectiveness through simulations and an ozone‑monitoring application.

By Jiongran Wang, Debdeep Pati, Anirban Bhattacharya
Hugging Face Trending Papers
Aug 13

Wasserstein Filtering: A Sample Selection Method for Robust Distribution Learning

Given a dataset where a portion of the samples are contaminated, our goal is to recover the underlying clean population distribution. To this end, we propose Wasserstein Filtering (WF), a novel sample selection framework that discards a fraction of suspicious samples and estimates the target distribution using the empirical measure of the remaining data.

arXiv AI
Oct 5

Distributionally Robust Survival Models under Subpopulation Shift and Outlier Contamination

The paper introduces a distributionally robust framework for survival analysis that simultaneously tackles latent subpopulation shift and outlier contamination. It employs an outer minimization to refine the nominal distribution by down-weighting contaminated samples and an inner maximization to target the most challenging subpopulation, directly handling non-decomposable survival losses such as the Cox partial log-likelihood. An alternating gradient-based algorithm, guided by KKT conditions, is developed, and experiments on simulated data and two benchmarks show improved worst-group performance and stable training under contamination.

By Seonghwi Kim, Sung Ho Jo, Minwoo Chae
arXiv Machine Learning
Jul 7

Robust Bayes-Assisted Conformal Prediction

arXiv:2607. 04236v1 Announce Type: cross Abstract: Bayes-assisted conformal prediction combines the strengths of Bayesian modelling with exact, distribution-free frequentist coverage guarantees.

By Kianoosh Ashouritaklimi, Stefano Cortinovis, Fran\c{c}ois Caron
arXiv Machine Learning
Oct 23

Prediction Uncertainty Controlled Computer Model Calibration

The paper introduces a two‑layer framework for computer‑model calibration that directly controls predictive miscoverage. First, a conditional flow‑matching model learns an amortized posterior for calibration parameters using simulator outputs perturbed with Gaussian‑process discrepancies. Second, conformal risk control arranges posterior draws into nested candidate sets and selects the smallest set whose fixed‑rank pointwise bands achieve a prescribed time‑averaged miscoverage on a synthetic calibration sample. The method yields bands that are about 20% the width of traditional KOH‑MCMC bands while maintaining near‑nominal miscoverage, and when applied to an age‑structured SEIR model of the 2010 Malawi measles outbreak, the bands are sharper and highlight structural inadequacies in the mechanistic model.

By Ryan Heejoon Byun, Dayeon Yoon, Won Chang
arXiv Machine Learning
Oct 7

ProximalFM: Amortized Proximal Causal Inference under Hidden Confounding

ProximalFM is a transformer‑based model that uses prior‑data fitted networks (PFNs) to perform Bayesian proximal causal inference under hidden confounding. By training on synthetic data generated from structural causal models with oracle counterfactuals, it amortizes the Bayesian operator inversion into a single forward pass, producing posterior estimates of the conditional average treatment effect (CATE). The approach consistently outperforms prior methods across various proximal regimes, especially when latent confounding is strong and proxy variables are weakly informative, and it requires no dataset‑specific tuning.

By Christophe Muller, Ayub Kharel, Alex Luedtke, Chan Park, Eric Tchetgen Tchetgen, Juan L. Gamella, Rahul Krishnan, Ricardo Silva, Jakob Zeitler