Hugging Face Trending Papers

Ensemble Controlled-Flow Filtering for Implicit Data Assimilation

Data assimilation estimates the state of a dynamical system from model forecasts and incoming observations. Many observation mechanisms, however, are many-to-one, implicit, non-smooth, or accessible only through simulation, and need not provide the residual structures or likelihood guidance required by existing ensemble filters.

arXiv Machine Learning
Sep 23

FREESIA: Covariance-Aware Posterior Transport for Expressive and Scalable Data Assimilation

The paper introduces FREESIA, a training‑free, covariance‑aware posterior transport method for data assimilation that embeds forecast cross‑covariance into a flow‑based transport to recover unobserved states while preserving non‑Gaussian posterior structure. It combines an observation‑adaptive proposal with posterior correction, providing an asymptotically exact approximation of nonlinear posteriors and a Wasserstein error bound. Experiments on Double‑Well, Lorenz‑96, and Kolmogorov flow demonstrate that FREESIA captures complex posterior structures and achieves up to a 56% reduction in RMSE compared to the best baseline in sparse, nonlinear, non‑injective observation scenarios.

By Shiwei Ni, Yangwen Zhang, Hang Qi, Xiaofei Guan, Lili Ju
arXiv Statistics ML
Sep 17

A Continuous-Time Ensemble Kalman-Bucy Smoother for Causal Inference and Model Discovery

The paper presents an ensemble Kalman–Bucy smoother (EnKBS) for continuous‑time data assimilation of nonlinear dynamical systems, reconstructing conditional distributions from ensemble moments without needing tangent‑linear or adjoint models. It demonstrates that EnKBS achieves exact smoothing mean and covariance in the infinite‑ensemble limit for linear‑Gaussian systems and incorporates regularization techniques like covariance localization and inflation for high‑dimensional problems. The method is applied to Bayesian inference of causal relationships in a dyadic trigger‑feedback model and to an iterative learning algorithm that uncovers the structure and hidden parameters of a reduced‑order model of midlatitude atmospheric circulation, all with small ensembles under partial observations.

By Zhang Jiang (University of Wisconsin-Madison), Marios Andreou (University of Wisconsin-Madison), Sebastian Reich (University of Potsdam), Nan Chen (University of Wisconsin-Madison)