arXiv Machine Learning

AECSF: Adaptive Ensemble Conditional Score Filtering for High-Dimensional Nonlinear Data Assimilation

AECSF: Adaptive Ensemble Conditional Score Filtering for High‑Dimensional Nonlinear Data Assimilation proposes a training‑free adaptive ensemble conditional score filter that constructs an analytically tractable score estimator using the conditional Tweedie identity. The method employs a shared adaptive weighted proposal ensemble to efficiently estimate conditional means for each noisy reverse particle, updating the proposal within the same reverse‑diffusion run. Theoretical analysis characterizes when a fixed weighted proposal yields the exact noisy posterior score and bounds the error between conditional‑mean estimation and reverse‑sampling endpoint error, while numerical experiments show improved posterior sampling and nonlinear filtering accuracy in high‑dimensional problems with limited forecast ensembles.

arXiv Machine Learning
Sep 22

Bayesian Filtering in Physical Systems via Test-time Trained Flow Matching

The paper introduces the Belief Flow Filter (BFF), a generative filtering framework that encodes the evolving posterior distribution directly into flow matching model weights and updates them via test‑time gradient descent. By avoiding particle representations and Gaussian assumptions, BFF aligns structurally with Bayesian filtering and targets the recursive filtering operator. Empirical results on five physical systems—including chaotic dynamics, sparse observations, and a tokamak plasma estimation task—show that BFF outperforms existing methods in most benchmark metrics.

By Ruiqi Feng, Chongyi Wang, Tao Zhang, Tailin Wu
arXiv Machine Learning
Sep 23

FREESIA: Covariance-Aware Posterior Transport for Expressive and Scalable Data Assimilation

The paper introduces FREESIA, a training‑free, covariance‑aware posterior transport method for data assimilation that embeds forecast cross‑covariance into a flow‑based transport to recover unobserved states while preserving non‑Gaussian posterior structure. It combines an observation‑adaptive proposal with posterior correction, providing an asymptotically exact approximation of nonlinear posteriors and a Wasserstein error bound. Experiments on Double‑Well, Lorenz‑96, and Kolmogorov flow demonstrate that FREESIA captures complex posterior structures and achieves up to a 56% reduction in RMSE compared to the best baseline in sparse, nonlinear, non‑injective observation scenarios.

By Shiwei Ni, Yangwen Zhang, Hang Qi, Xiaofei Guan, Lili Ju