arXiv Machine Learning

EnJoi: Ensemble Joint Score Filter for Generative Data Assimilation

arXiv Machine Learning
Oct 5

A Unified Framework for Bayesian Data Assimilation with Generative Models and Observation Interpolants

A new framework for Bayesian data assimilation is presented that leverages pretrained stochastic interpolants, flow matching, and diffusion models as posterior samplers without retraining. By conditioning the interpolant path on observations, a shared likelihood‑score correction is applied to the drift or velocity, unifying stochastic and deterministic sampling methods. The approach yields exact posterior samples when the intermediate likelihood score is known, and practical approximations use a Gaussian surrogate with bias‑corrected mean and inflated covariance, enabling tractable high‑dimensional applications such as linear‑Gaussian dynamics, stochastic Navier‑Stokes, and urban airflow simulations with up to $O(10^4)$ degrees of freedom.

By Nikolaj T. M\"ucke, Benjamin Sanderse
arXiv Machine Learning
Nov 6

A Survey of Nonlinear Filtering Methods for Data Assimilation and Recent Advances in Generative AI-Enabled Score Filters

The paper surveys nonlinear filtering methods for data assimilation, highlighting challenges in chaotic, high‑dimensional systems. It introduces the Ensemble Score Filter (EnSF), which encodes filtering densities via a score function and uses a training‑free Monte Carlo estimator to avoid Gaussian assumptions, particle collapse, and kernel scalability issues. The survey reviews EnSF’s mathematical foundations and fourteen extensions, noting that most retain the core estimator while two adapt it for planetary‑scale deployment.

By Cath Pham, Kadesha Reynolds