Hugging Face Trending Papers

Prior-Amortized In-Context Bayesian Inference for Generalized Linear Mixed-Effects Models

arXiv Machine Learning
Oct 7

ProximalFM: Amortized Proximal Causal Inference under Hidden Confounding

ProximalFM is a transformer‑based model that uses prior‑data fitted networks (PFNs) to perform Bayesian proximal causal inference under hidden confounding. By training on synthetic data generated from structural causal models with oracle counterfactuals, it amortizes the Bayesian operator inversion into a single forward pass, producing posterior estimates of the conditional average treatment effect (CATE). The approach consistently outperforms prior methods across various proximal regimes, especially when latent confounding is strong and proxy variables are weakly informative, and it requires no dataset‑specific tuning.

By Christophe Muller, Ayub Kharel, Alex Luedtke, Chan Park, Eric Tchetgen Tchetgen, Juan L. Gamella, Rahul Krishnan, Ricardo Silva, Jakob Zeitler
arXiv Machine Learning
Oct 19

ENFR: Evidence Networks with Flow-Matched References for Amortized Simulation-Based Model Inference

The paper introduces ENFR, a method for estimating the absolute evidence ζ of a data‑generating model in Bayesian inference. It learns Bayes factors relative to a flow‑matched reference and then recovers the absolute evidence, improving over existing flow‑based baselines across multiple applications. The authors also provide a joint architecture for estimating evidences of multiple models and demonstrate its performance and scalability on diverse scientific datasets.

By Kai Lehman, Jameson Dong, Carolina Cuesta-Lazaro, Niall Jeffrey, Benjamin D. Wandelt, Francisco Villaescusa-Navarro, Sven Krippendorf, Jochen Weller
arXiv Machine Learning
Oct 28

Adapting Neural Posterior Estimators for Simulation-Based Inference in Agent-Based Models

The paper presents a framework called SNPE‑TTT for adapting pre‑trained neural posterior estimators, specifically conditional normalizing flows, to new inference tasks in agent‑based models (ABMs). It explores four adaptation strategies—full‑parameter adaptation, low‑rank adaptation, and two gradient‑based update spaces—and evaluates them on economic simulation models with both tractable and intractable likelihoods. Results show that the framework can improve posterior recovery with a limited number of target simulations, though performance varies by task and adaptation method.

By Junyao Zhang, Jinglai Li, Junqi Tang
arXiv Statistics ML
Oct 2

IQS-BO: In-Context Query Selection for Bayesian Optimisation

IQS-BO introduces an in‑context query selection method for Bayesian optimisation that learns to choose evaluation points via supervised learning on synthetic priors. The approach uses a Prior‑data Fitted Network (PFN) to predict, in a single forward pass, the probability that each candidate maximises the objective, thereby amortising the decision step and eliminating the need for costly surrogate refitting or acquisition maximisation. Experiments show that IQS‑BO matches or surpasses traditional Gaussian‑process‑based BO and other in‑context methods on both synthetic and real‑world benchmarks, and that a mixture prior combining GP samples with challenging function types further improves performance.

By Luca Geminiani, Nadja Klein
arXiv Machine Learning
Oct 16

Amortized Factor Inference Networks for Posterior Inference

The paper introduces Amortized Factor Inference Networks (AFINs), a single inference network that can generalize across varying priors, likelihoods, latent dimensions, and observation counts. AFINs represent a model as a list of typed prior and likelihood factors and use an encode–merge–decode architecture to produce a Gaussian posterior approximation, with learned parameters independent of latent dimensionality or observation count. Experiments on synthetic and real datasets demonstrate that a single trained AFIN achieves competitive posterior approximations at significantly lower test‑time cost than NUTS and per‑task variational inference, with optional importance sampling further improving accuracy.

By Joohwan Ko, Justin Domke