Uncertainty-Aware End-to-End AI Weather Forecasting: Disentangling Observation and Model Contributions
Read the original on arXiv Machine Learning →The Flow has not summarised this story yet — read it at arXiv Machine Learning.
The Flow has not summarised this story yet — read it at arXiv Machine Learning.
arXiv:2508. 18486v2 Announce Type: replace-cross Abstract: Over the past few years, machine learning-based data-driven weather prediction has been transforming operational weather forecasting by providing more accurate forecasts while using a mere fraction of computing power compared to traditional numerical weather prediction (NWP).
The paper introduces Pangu‑Bayes, a probabilistic forecasting hierarchy that separates atmospheric‑state uncertainty from learned‑model uncertainty as distinct stochastic variables, allowing cross‑flow perturbations of the evolving state with Bayesian parameter samples. In tests on 90 held‑out 2023 tropical cyclones, Pangu‑Bayes reduces track, pressure, and wind errors by 54.2%, 17.2%, and 24.9% respectively, and improves rapid‑intensification detection. The study finds that atmospheric‑state variability more consistently improves track prediction, while learned‑model variability more often enhances intensity prediction, demonstrating how model‑defined uncertainty resolution can be linked to target‑dependent value and dynamical interpretation.
The paper introduces DIAL, a method that dynamically adjusts the native stochasticity of a frozen weather forecasting model to improve ensemble reliability across variables, scales, and lead times. DIAL learns from past forecasts to predict necessary spread adjustments and applies small noise updates during each forecast step, avoiding retraining or full backpropagation. Experiments on FourCastNet 3 show that DIAL outperforms post‑processing and reward‑based baselines, achieving an 8.27% improvement in multiscale CRPS over the unmodified model.
The paper presents Laxmi, a retrained version of the AIFS weather model that uses satellite-based precipitation observations instead of ERA5 reanalysis data. Laxmi achieves a 19% improvement in global probabilistic accuracy, reduces drizzle overprediction by 33%, and boosts the 95th percentile Brier skill score by 57%. In a case study of 10 Indian tropical storms, Laxmi accurately forecasted 150 mm event-total precipitation in 7 events, outperforming both the original AIFS and the leading physical model IFS.
The paper presents a probabilistic post‑processing framework that uses a conditional Variational Autoencoder (cVAE) with a non‑parametric decoder to adjust seasonal Arctic sea‑ice forecasts. By replacing the Gaussian decoder with a generator and optimizing with Continuous Ranked Probability Score (CRPS), the method produces larger, bias‑corrected ensembles that are better calibrated, more consistent with observations, and exhibit higher resolution and sharper spectral power than standard cVAEs. The approach demonstrates improved forecast skill and reduced errors compared to benchmark predictions.
The paper introduces Nested‑EAGLE, a 0.25° global weather model with a 6 km refinement over the contiguous United States, designed to merge short‑ and medium‑range forecasts into a single system. It shows lower mean‑squared error for near‑surface and low‑level variables over the U.S. compared to NOAA’s GFS and HRRR, while remaining competitive globally. Although precipitation forecasts are less skillful than HRRR’s deterministic training, Nested‑EAGLE delivers the most accurate storm‑location predictions at longer lead times, with blurred extrema.