arXiv Statistics ML

Covariance-Informed Ensemble Score Filtering: Embedding Localized Covariance Geometry into Score-Based Transport

arXiv Machine Learning
Sep 23

FREESIA: Covariance-Aware Posterior Transport for Expressive and Scalable Data Assimilation

The paper introduces FREESIA, a training‑free, covariance‑aware posterior transport method for data assimilation that embeds forecast cross‑covariance into a flow‑based transport to recover unobserved states while preserving non‑Gaussian posterior structure. It combines an observation‑adaptive proposal with posterior correction, providing an asymptotically exact approximation of nonlinear posteriors and a Wasserstein error bound. Experiments on Double‑Well, Lorenz‑96, and Kolmogorov flow demonstrate that FREESIA captures complex posterior structures and achieves up to a 56% reduction in RMSE compared to the best baseline in sparse, nonlinear, non‑injective observation scenarios.

By Shiwei Ni, Yangwen Zhang, Hang Qi, Xiaofei Guan, Lili Ju
arXiv Machine Learning
Oct 16

Feature-preserving Latent-EnKF for Data Assimilation of Flows with Shocks

The paper introduces a feature‑preserving latent‑EnKF for data assimilation of flows with shocks, addressing the failure of traditional EnKF when discontinuities are present. By updating ensembles in a low‑dimensional latent space learned via a coordinate‑conditioned auto‑decoder, the method maintains near‑Gaussian statistics and coherent flow features, enabling shock translation through coordinate morphing rather than superposition. Experiments on Sod shock‑tube, Mach 2 shock‑cylinder, and immersed‑body shape‑inference problems show accurate shock recovery without spurious oscillations.

By Hemanth Chandravamsi, Hangchuan Hu, Ponkrshnan Thiagarajan, Tamer A. Zaki
arXiv Statistics ML
Sep 17

A Continuous-Time Ensemble Kalman-Bucy Smoother for Causal Inference and Model Discovery

The paper presents an ensemble Kalman–Bucy smoother (EnKBS) for continuous‑time data assimilation of nonlinear dynamical systems, reconstructing conditional distributions from ensemble moments without needing tangent‑linear or adjoint models. It demonstrates that EnKBS achieves exact smoothing mean and covariance in the infinite‑ensemble limit for linear‑Gaussian systems and incorporates regularization techniques like covariance localization and inflation for high‑dimensional problems. The method is applied to Bayesian inference of causal relationships in a dyadic trigger‑feedback model and to an iterative learning algorithm that uncovers the structure and hidden parameters of a reduced‑order model of midlatitude atmospheric circulation, all with small ensembles under partial observations.

By Zhang Jiang (University of Wisconsin-Madison), Marios Andreou (University of Wisconsin-Madison), Sebastian Reich (University of Potsdam), Nan Chen (University of Wisconsin-Madison)
arXiv Machine Learning
Oct 5

AECSF: Adaptive Ensemble Conditional Score Filtering for High-Dimensional Nonlinear Data Assimilation

AECSF: Adaptive Ensemble Conditional Score Filtering for High‑Dimensional Nonlinear Data Assimilation proposes a training‑free adaptive ensemble conditional score filter that constructs an analytically tractable score estimator using the conditional Tweedie identity. The method employs a shared adaptive weighted proposal ensemble to efficiently estimate conditional means for each noisy reverse particle, updating the proposal within the same reverse‑diffusion run. Theoretical analysis characterizes when a fixed weighted proposal yields the exact noisy posterior score and bounds the error between conditional‑mean estimation and reverse‑sampling endpoint error, while numerical experiments show improved posterior sampling and nonlinear filtering accuracy in high‑dimensional problems with limited forecast ensembles.

By Yangwen Zhang, Shiwei Ni, Xiaoping Zhang, Xiaofei Guan, Lili Ju