arXiv Machine Learning

Improving Ensemble Filters with Flow Matching

arXiv Machine Learning
Sep 23

FREESIA: Covariance-Aware Posterior Transport for Expressive and Scalable Data Assimilation

The paper introduces FREESIA, a training‑free, covariance‑aware posterior transport method for data assimilation that embeds forecast cross‑covariance into a flow‑based transport to recover unobserved states while preserving non‑Gaussian posterior structure. It combines an observation‑adaptive proposal with posterior correction, providing an asymptotically exact approximation of nonlinear posteriors and a Wasserstein error bound. Experiments on Double‑Well, Lorenz‑96, and Kolmogorov flow demonstrate that FREESIA captures complex posterior structures and achieves up to a 56% reduction in RMSE compared to the best baseline in sparse, nonlinear, non‑injective observation scenarios.

By Shiwei Ni, Yangwen Zhang, Hang Qi, Xiaofei Guan, Lili Ju
arXiv Machine Learning
Nov 6

A Survey of Nonlinear Filtering Methods for Data Assimilation and Recent Advances in Generative AI-Enabled Score Filters

The paper surveys nonlinear filtering methods for data assimilation, highlighting challenges in chaotic, high‑dimensional systems. It introduces the Ensemble Score Filter (EnSF), which encodes filtering densities via a score function and uses a training‑free Monte Carlo estimator to avoid Gaussian assumptions, particle collapse, and kernel scalability issues. The survey reviews EnSF’s mathematical foundations and fourteen extensions, noting that most retain the core estimator while two adapt it for planetary‑scale deployment.

By Cath Pham, Kadesha Reynolds
arXiv Machine Learning
Oct 5

A Unified Framework for Bayesian Data Assimilation with Generative Models and Observation Interpolants

A new framework for Bayesian data assimilation is presented that leverages pretrained stochastic interpolants, flow matching, and diffusion models as posterior samplers without retraining. By conditioning the interpolant path on observations, a shared likelihood‑score correction is applied to the drift or velocity, unifying stochastic and deterministic sampling methods. The approach yields exact posterior samples when the intermediate likelihood score is known, and practical approximations use a Gaussian surrogate with bias‑corrected mean and inflated covariance, enabling tractable high‑dimensional applications such as linear‑Gaussian dynamics, stochastic Navier‑Stokes, and urban airflow simulations with up to $O(10^4)$ degrees of freedom.

By Nikolaj T. M\"ucke, Benjamin Sanderse