arXiv Machine Learning

Forecasting Multiple Observables with SCROLL: Score-Trained Uncertainty for Stochastic Dynamics

The paper introduces SCROLL, a method for forecasting multiple observables in stochastic dynamical systems by composing each observable’s likelihood into per‑task free‑routed last‑layer beliefs on a shared backbone. This approach learns unit‑dependent loss scaling directly from data, enabling accurate predictive variance estimation without separate tuning. Experiments on the Ornstein–Uhlenbeck process, stochastic Lorenz‑63, and real air‑quality data show that SCROLL recovers analytic kernels, achieves superior negative log‑likelihood on state and regime tasks, and maintains calibration while reducing hyper‑parameter search costs.

arXiv Computer Vision
Oct 16

DIAL: Dynamic and Informed Adjustment of the Native Stochastic Law for Reliable Weather Ensembles

The paper introduces DIAL, a method that dynamically adjusts the native stochasticity of a frozen weather forecasting model to improve ensemble reliability across variables, scales, and lead times. DIAL learns from past forecasts to predict necessary spread adjustments and applies small noise updates during each forecast step, avoiding retraining or full backpropagation. Experiments on FourCastNet 3 show that DIAL outperforms post‑processing and reward‑based baselines, achieving an 8.27% improvement in multiscale CRPS over the unmodified model.

By Yucheng Wang, Haonan Guo, Tianhao Zhao, Di Wang, Yu Wu, Zengmao Wang, Bo Du
arXiv Machine Learning
Oct 2

Proper Scoring Rule-based Diffusion for Probabilistic Weather Forecasting

The paper introduces a new diffusion-based approach for probabilistic weather forecasting that incorporates auxiliary conditional denoising tasks. By predicting future states from both clean and corrupted contexts, the model reduces ambiguity and learns conditional distributions across noise levels using a proper scoring rule. Experiments demonstrate improved one‑step forecasting, especially at longer horizons, and better calibration in high‑dimensional global weather scenarios.

By Joonhyeong Park, Giung Nam, Hyungi Lee, Kyunghyun Cho, Byoungwoo Park, Juho Lee
arXiv Machine Learning
Jul 14

A Control Theory of Predictability in Latent World Models

arXiv:2607. 10362v1 Announce Type: new Abstract: Latent world models are trained to predict future states in a learned representation and are then deployed inside a planner that selects actions by simulating them forward.

By Hanzhe You, Yonggang Zhang, Maohao Ran, Zhiqin Yang, Zhenyuan Zhang, Wei Xue, Jun Song, Xinmei Tian, Yike Guo
arXiv Machine Learning
Oct 8

Artificial intelligence pathways from weather to climate

arXiv:2610.09770v1 Announce Type: cross Abstract: Deep learning has made rapid advances in weather forecasting: autoregressive models trained on atmospheric reanalyses now rival dynamical models acro...

By Tom Beucler, J. David Neelin, Hui Su, Shivanshi Asthana, Chris Bretherton, Will Chapman, Costa Christopoulos, Spencer K. Clark, Aditya Grover, Ignacio Lopez-Gomez, Tapio Schneider, Adam Subel, Oliver Watt-Meyer
arXiv Machine Learning
Sep 14

Large Distant Gradients Need Not Be Reliable: reliability-weighted credit assignment for long-horizon autoregressive forecasting

The paper introduces Internal Dual-Wiener routing (Internal‑DW), a backward‑only method that weight‑balances internal gradient routes in autoregressive forecasting. By estimating bounded Wiener gains for identity and nonlinear paths, it suppresses unpredictable noise while preserving predictable learning signals, reducing forecast error by 5.2%–13.8% on four weak‑drive testbeds compared to full BPTT and outperforming gradient clipping, Jacobian regularization, and truncated BPTT in most cases. The approach shows that long‑horizon supervision can be effective without trusting every backward gradient equally.

By Junhao Zhao, David Michael Simberg, Jacob Kang, Colin Connor Kurniawan, Nan Xu
arXiv Statistics ML
6d ago

Batched NN 4D-Var: a performant hybrid model framework for the Integrated Forecasting System

Hybrid forecasting systems that combine machine learning with numerical weather prediction are explored using a neural‑network representation of model error within the Integrated Forecasting System. The study introduces a targeted neural‑network 4D‑Var approach that estimates only network parameters and a batched extension that processes assimilation windows in random order, averaging parameter updates across multiple windows. Experiments show that while sequential online learning improves forecasts during training, it fails to generalise, whereas the batched formulation consistently enhances out‑of‑sample forecast skill and improves convergence with larger batch sizes.

By Alban Farchi, Marcin Chrust, Massimo Bonavita, Marc Bocquet, Wei Pan, Patrick Laloyaux