arXiv Statistics ML By Alban Farchi, Marcin Chrust, Massimo Bonavita, Marc Bocquet, Wei Pan, Patrick Laloyaux

Batched NN 4D-Var: a performant hybrid model framework for the Integrated Forecasting System

Read the original on arXiv Statistics ML →

Hybrid forecasting systems that combine machine learning with numerical weather prediction are explored using a neural‑network representation of model error within the Integrated Forecasting System. The study introduces a targeted neural‑network 4D‑Var approach that estimates only network parameters and a batched extension that processes assimilation windows in random order, averaging parameter updates across multiple windows. Experiments show that while sequential online learning improves forecasts during training, it fails to generalise, whereas the batched formulation consistently enhances out‑of‑sample forecast skill and improves convergence with larger batch sizes.

Machine-generated by The Flow from the publisher's headline and feed description — not written or checked by a human. The full article lives at arXiv Statistics ML.

arXiv Machine Learning
Oct 8

Artificial intelligence pathways from weather to climate

arXiv:2610.09770v1 Announce Type: cross Abstract: Deep learning has made rapid advances in weather forecasting: autoregressive models trained on atmospheric reanalyses now rival dynamical models acro...

By Tom Beucler, J. David Neelin, Hui Su, Shivanshi Asthana, Chris Bretherton, Will Chapman, Costa Christopoulos, Spencer K. Clark, Aditya Grover, Ignacio Lopez-Gomez, Tapio Schneider, Adam Subel, Oliver Watt-Meyer
arXiv Machine Learning
Jun 9

ForcingDAS: Unified and Robust Data Assimilation via Diffusion Forcing

arXiv:2605. 14285v2 Announce Type: replace-cross Abstract: Data assimilation (DA) estimates the state of an evolving dynamical system from noisy, partial observations, and is widely used in scientific simulation as well as weather and climate science.

By Yixuan Jia, Siyi Chen, Yida Pan, Xiao Li, Lianghe Shi, Chanyong Jung, Haijie Yuan, Ismail Alkhouri, Yue Cynthia Wu, Saiprasad Ravishankar, Jeffrey A Fessler, Qing Qu
arXiv AI
Oct 2

Benchmarking Generative Models for Weather Data Assimilation on Real Station Observations

This study introduces the first controlled benchmark of generative models for weather data assimilation using real station observations from 11,849 NOAA MADIS stations across the U.S. It evaluates key design choices—diffusion vs. flow matching, pixel vs. latent-space formulations, and inference-time conditioning strategies—against a classical 3D-Var baseline. The benchmark finds that learned generative priors and full-gradient guidance improve RMSE over ERA5, while other design variations offer minimal benefit, especially under sparse observation conditions.

By Ruizhe Huang, Qidong Yang, Jonathan Giezendanner, Sherrie Wang