arXiv:2508. 18486v2 Announce Type: replace-cross Abstract: Over the past few years, machine learning-based data-driven weather prediction has been transforming operational weather forecasting by providing more accurate forecasts while using a mere fraction of computing power compared to traditional numerical weather prediction (NWP).
By Zekun Ni, Jonathan Weyn, Hang Zhang, Yanfei Xiang, Jiang Bian, Weixin Jin, Kit Thambiratnam, Qi Zhang, Haiyu Dong, Hongyu Sun
The paper presents a framework called auto‑differentiable filtering that jointly learns the state, dynamics, and filtering algorithm parameters in data assimilation. It uses a loss function that allows gradient‑based optimization from partial, noisy observations via auto‑differentiation. Experiments demonstrate the method on diverse dynamical systems, including aerospace, atmospheric, biological, and geophysical models, and the authors offer guidelines for tailoring the framework to specific observation models, accuracy needs, and computational budgets.
By Melissa Adrian, Daniel Sanz-Alonso, Rebecca Willett
Hybrid forecasting systems that combine machine learning with numerical weather prediction are explored using a neural‑network representation of model error within the Integrated Forecasting System. The study introduces a targeted neural‑network 4D‑Var approach that estimates only network parameters and a batched extension that processes assimilation windows in random order, averaging parameter updates across multiple windows. Experiments show that while sequential online learning improves forecasts during training, it fails to generalise, whereas the batched formulation consistently enhances out‑of‑sample forecast skill and improves convergence with larger batch sizes.
By Alban Farchi, Marcin Chrust, Massimo Bonavita, Marc Bocquet, Wei Pan, Patrick Laloyaux
arXiv:2609.35944v1 Announce Type: new
Abstract: Data Assimilation (DA) aims to recover the full state of a dynamical system that is only partially observed. A solution is to use Score-based models to...
By Julien Moreau, Marc Lelarge
arXiv:2608. 05103v1 Announce Type: new Abstract: Data assimilation (DA) uses Bayesian inference to update the state of a numerical forecast model with observed data.
By Dibyajyoti Chakraborty, Romit Maulik
arXiv:2608. 05103v2 Announce Type: replace Abstract: Data assimilation (DA) uses Bayesian inference to update the state of a numerical forecast model with observed data.
By Dibyajyoti Chakraborty, Romit Maulik
arXiv:2609.28015v1 Announce Type: cross
Abstract: Data assimilation estimates a dynamical state from partial and noisy observations. Classical ensemble filters are efficient but restrict analysis upd...
By Haoyuan Chen, Alexandre Thi\'ery
arXiv:2610.03314v1 Announce Type: cross
Abstract: Flow- and diffusion-based generative models have recently emerged as flexible and highly efficient forecasting models for dynamical systems. When com...
By Erik Wikingsson, Martin Andrae, Tomas Landelius, Fredrik Lindsten
arXiv:2410. 10523v3 Announce Type: replace-cross Abstract: The aim of this book is to demonstrate the potential for ideas in machine learning to impact on the fields of inverse problems and data assimilation.
By Eviatar Bach, Ricardo Baptista, Daniel Sanz-Alonso, Andrew Stuart
The paper surveys nonlinear filtering methods for data assimilation, highlighting challenges in chaotic, high‑dimensional systems. It introduces the Ensemble Score Filter (EnSF), which encodes filtering densities via a score function and uses a training‑free Monte Carlo estimator to avoid Gaussian assumptions, particle collapse, and kernel scalability issues. The survey reviews EnSF’s mathematical foundations and fourteen extensions, noting that most retain the core estimator while two adapt it for planetary‑scale deployment.
By Cath Pham, Kadesha Reynolds
arXiv:2605. 29072v2 Announce Type: replace Abstract: Accurate estimation and forecasting of energy consumption are important for power-system operation, planning, and demand-side management.
By Ruoyu Hu, Dahai Yu, Feng Bao, Guang Wang, Guannan Zhang
WeatherDreamer is a new end‑to‑end world model that learns the recursive filtering cycle of data assimilation directly from 18 global observing systems, without relying on traditional reanalysis. It infers a latent atmospheric state, propagates it hourly with learned dynamics, and corrects it each hour using new observations, enabling it to predict measurements for any observing system. In held‑out tests, its ensembles outperform NOAA’s GEFS for temperature, dew point, and wind out to 12 h, and its skill for precipitation, cloud‑top height, and solar irradiance matches or exceeds operational products.
By Kate Duffy, Elise Penn, Tristan Ballard, August Posch, Thomas J. Vandal