arXiv Machine Learning

ForcingDAS: Unified and Robust Data Assimilation via Diffusion Forcing

arXiv:2605. 14285v2 Announce Type: replace-cross Abstract: Data assimilation (DA) estimates the state of an evolving dynamical system from noisy, partial observations, and is widely used in scientific simulation as well as weather and climate science.

arXiv AI
Sep 2

Global Attention with Linear Complexity for Exascale Generative Data Assimilation in Earth System Prediction

The paper introduces STORM, a one‑stage generative AI framework that reformulates Earth system data assimilation as diffusion‑based Bayesian posterior sampling, replacing costly PDE ensemble forecasts with scalable AI inference. STORM employs a spatiotemporal transformer with a global‑attention algorithm that reduces computational complexity from quadratic to linear, enabling high‑resolution, long‑context modeling. The system scales to 74,400 GPUs on Frontier, achieving 96–99 % strong‑scaling efficiency and up to 6 ExaFLOPs sustained BF16 throughput, while supporting 32,768‑member ensembles for uncertainty quantification in just 34 seconds on 4,096 GPUs, and demonstrates improved hurricane tracking and climate reanalysis accuracy.

By Xiao Wang, Zezhong Zhang, Isaac Lyngaas, Hong-Jun Yoon, Jong-Youl Choi, Siming Liang, Janet Wang, Hristo G. Chipilski, Ashwin M. Aji, Feng Bao, Peter Jan van Leeuwen, Dan Lu, Guannan Zhang
arXiv AI
2d ago

Benchmarking Generative Models for Weather Data Assimilation on Real Station Observations

This study introduces the first controlled benchmark of generative models for weather data assimilation using real station observations from 11,849 NOAA MADIS stations across the U.S. It evaluates key design choices—diffusion vs. flow matching, pixel vs. latent-space formulations, and inference-time conditioning strategies—against a classical 3D-Var baseline. The benchmark finds that learned generative priors and full-gradient guidance improve RMSE over ERA5, while other design variations offer minimal benefit, especially under sparse observation conditions.

By Ruizhe Huang, Qidong Yang, Jonathan Giezendanner, Sherrie Wang
arXiv Machine Learning
Sep 4

SimCast-S2S: A Computationally Efficient Diffusion Model for Subseasonal Precipitation Forecasting

SimCast‑S2S is a generative latent‑diffusion framework designed for probabilistic subseasonal‑to‑seasonal precipitation forecasting. It tackles three key challenges: it uses a diffusion‑based generative pipeline for uncertainty quantification, operates in a compact latent space learned by VAEs for efficient large‑ensemble generation, and employs transfer learning with LoRA to overcome limited training data. On reanalysis data, it outperforms deep‑learning baselines and competes with or surpasses state‑of‑the‑art operational systems such as ECMWF‑S2S.

By Hiep V. Dang, Antonios Mamalakis
arXiv Machine Learning
Aug 28

SimCast-S2S: An Efficient Generative Model for Subseasonal Precipitation Forecasting via Transfer Learning from Climate Simulations

SimCast‑S2S is a generative latent‑diffusion model designed for probabilistic subseasonal‑to‑seasonal precipitation forecasting. It tackles three key challenges: it uses a diffusion pipeline to capture uncertainty, operates in a compact latent space to enable efficient large‑ensemble generation, and leverages transfer learning with low‑rank adaptation to train on limited reanalysis data after pretraining on climate simulations. The model outperforms deep‑learning baselines and competes with, or surpasses, operational systems such as the ECMWF‑S2S baseline without requiring extensive post‑processing.

By Hiep V. Dang, Antonios Mamalakis
arXiv AI
Sep 10

Resolving sources of uncertainty in AI weather forecasting

The paper introduces Pangu‑Bayes, a probabilistic forecasting hierarchy that separates atmospheric‑state uncertainty from learned‑model uncertainty as distinct stochastic variables, allowing cross‑flow perturbations of the evolving state with Bayesian parameter samples. In tests on 90 held‑out 2023 tropical cyclones, Pangu‑Bayes reduces track, pressure, and wind errors by 54.2%, 17.2%, and 24.9% respectively, and improves rapid‑intensification detection. The study finds that atmospheric‑state variability more consistently improves track prediction, while learned‑model variability more often enhances intensity prediction, demonstrating how model‑defined uncertainty resolution can be linked to target‑dependent value and dynamical interpretation.

By Wenbo Hu, Xinlei Xiong, Shuxun Zhou, Kaifeng Bi, Lingxi Xie, Jun Zhu, Richang Hong, Qi Tian