arXiv AI

Benchmarking Generative Models for Weather Data Assimilation on Real Station Observations

arXiv Machine Learning
Aug 28

SimCast-S2S: An Efficient Generative Model for Subseasonal Precipitation Forecasting via Transfer Learning from Climate Simulations

SimCast‑S2S is a generative latent‑diffusion model designed for probabilistic subseasonal‑to‑seasonal precipitation forecasting. It tackles three key challenges: it uses a diffusion pipeline to capture uncertainty, operates in a compact latent space to enable efficient large‑ensemble generation, and leverages transfer learning with low‑rank adaptation to train on limited reanalysis data after pretraining on climate simulations. The model outperforms deep‑learning baselines and competes with, or surpasses, operational systems such as the ECMWF‑S2S baseline without requiring extensive post‑processing.

By Hiep V. Dang, Antonios Mamalakis
arXiv Machine Learning
Sep 4

SimCast-S2S: A Computationally Efficient Diffusion Model for Subseasonal Precipitation Forecasting

SimCast‑S2S is a generative latent‑diffusion framework designed for probabilistic subseasonal‑to‑seasonal precipitation forecasting. It tackles three key challenges: it uses a diffusion‑based generative pipeline for uncertainty quantification, operates in a compact latent space learned by VAEs for efficient large‑ensemble generation, and employs transfer learning with LoRA to overcome limited training data. On reanalysis data, it outperforms deep‑learning baselines and competes with or surpasses state‑of‑the‑art operational systems such as ECMWF‑S2S.

By Hiep V. Dang, Antonios Mamalakis
arXiv Machine Learning
Aug 31

Prequential posteriors

The paper introduces prequential posteriors, a Bayesian approach that uses a predictive‑sequential loss function to update deep generative forecasting models (DGFMs) when new data arrive. By adopting a consistency notion suitable for model misspecification, the authors prove that both the loss minimizer and the posterior concentrate on parameters with optimal predictive performance. Scalable inference is achieved with parallelisable waste‑free sequential Monte Carlo samplers that employ preconditioned gradient kernels, and the method is validated on synthetic and real meteorological time‑series data.

By Shreya Sinha-Roy, Richard G. Everitt, Christian P. Robert, Ritabrata Dutta
arXiv AI
Sep 2

Global Attention with Linear Complexity for Exascale Generative Data Assimilation in Earth System Prediction

The paper introduces STORM, a one‑stage generative AI framework that reformulates Earth system data assimilation as diffusion‑based Bayesian posterior sampling, replacing costly PDE ensemble forecasts with scalable AI inference. STORM employs a spatiotemporal transformer with a global‑attention algorithm that reduces computational complexity from quadratic to linear, enabling high‑resolution, long‑context modeling. The system scales to 74,400 GPUs on Frontier, achieving 96–99 % strong‑scaling efficiency and up to 6 ExaFLOPs sustained BF16 throughput, while supporting 32,768‑member ensembles for uncertainty quantification in just 34 seconds on 4,096 GPUs, and demonstrates improved hurricane tracking and climate reanalysis accuracy.

By Xiao Wang, Zezhong Zhang, Isaac Lyngaas, Hong-Jun Yoon, Jong-Youl Choi, Siming Liang, Janet Wang, Hristo G. Chipilski, Ashwin M. Aji, Feng Bao, Peter Jan van Leeuwen, Dan Lu, Guannan Zhang
arXiv Machine Learning
Jun 9

ForcingDAS: Unified and Robust Data Assimilation via Diffusion Forcing

arXiv:2605. 14285v2 Announce Type: replace-cross Abstract: Data assimilation (DA) estimates the state of an evolving dynamical system from noisy, partial observations, and is widely used in scientific simulation as well as weather and climate science.

By Yixuan Jia, Siyi Chen, Yida Pan, Xiao Li, Lianghe Shi, Chanyong Jung, Haijie Yuan, Ismail Alkhouri, Yue Cynthia Wu, Saiprasad Ravishankar, Jeffrey A Fessler, Qing Qu
arXiv Machine Learning
Sep 21

Learning to Advect: A Neural Semi-Lagrangian Architecture for Weather Forecasting

arXiv:2601.21151v3 Announce Type: replace Abstract: Machine-learning approaches to weather forecasting often employ a monolithic architecture in which distinct physical mechanisms, such as advection,...

By Carlos A. Pereira, St\'ephane Gaudreault, Valentin Dallerit, Christopher Subich, Shoyon Panday, Siqi Wei, Sasa Zhang, Siddharth Rout, Eldad Haber, Raymond J. Spiteri, David Millard
arXiv Machine Learning
Jun 30

High-Resolution Climate Projections Using Diffusion-Based Downscaling of a Lightweight Climate Emulator

arXiv:2602. 13416v2 Announce Type: replace Abstract: The proliferation of data-driven models in weather and climate sciences has marked a significant paradigm shift, with advanced models demonstrating exceptional skill in medium-range forecasting.

By Haiwen Guan, Dibyajyoti Chakraborty, Moein Darman, Troy Arcomano, Ashesh Chattopadhyay, Romit Maulik
arXiv Machine Learning
Sep 22

UniGIO: Unified Generative Global In-situ Weather Modeling from Spatiotemporal Incomplete Observations

UniGIO is a generative framework that models global in‑situ weather dynamics directly from incomplete GIO data, unifying forecasting, imputation, and generation across arbitrary missing ratios. It employs an Observation Mixer, Event Aligner, Adaptive Temporal Mixer, and a Mixture‑of‑Experts structure to capture station‑level complementarity, temporal dependencies, and extreme events, refining outputs with a Local Refiner. Experiments on the Weather‑5K dataset show state‑of‑the‑art performance, improving accuracy, fidelity, and extreme event capture by 11%, 12%, and 5% respectively.

By Songru Yang, Zili Liu, Tao Han, Ben Fei, Lei Bai, Chang Liu, Zhengxia Zou, Xiangyang Ji, Wanli Ouyang, Zhenwei Shi