arXiv Machine Learning July 7, 2026 By Janet Wang, Yunbei Zhang, Lin Zhao, Xi Xiao, Jihun Hamm, Xiao Wang

Less Tokens, Better Forecasts: Sparse Residual Routing for Efficient Weather Prediction

Read the original on arXiv Machine Learning →

arXiv:2607. 02829v1 Announce Type: new Abstract: Existing ViT-based weather forecasting models apply uniform computation across all spatial tokens, even though nearby atmospheric grid points often contain similar values and large regions evolve smoothly over time.

Summary generated by The Flow from the publisher's feed. The full article lives at arXiv Machine Learning.

arXiv AI

Jul 29

At-the-Roofline Sparse Tensor Contractions on Vector Processors for Transformer Inference

arXiv:2607. 25504v1 Announce Type: cross Abstract: Fine-grained weight pruning and activation sparsification have emerged as effective approaches for reducing the compute and memory cost of inference for Transformer models.

By Bowen Wang, Chi Zhang, Diyou Shen, Renzo Andri, Navaneeth Kunhi Purayil, Luca Benini

llms efficiency

arXiv Machine Learning

Jul 28

MMOE: Modernizing Diffusion Transformers with Efficient Expert Design

arXiv:2607. 24665v1 Announce Type: cross Abstract: Modern large language models scale successfully by pairing capacity growth with efficiency, keeping per-token and deployment costs under control as capacity grows.

By Yanhao Jia, Jiepeng Wang, Haibin Huang, Chi Zhang, Erik Cambria, Xuelong Li

llms diffusion efficiency

arXiv Machine Learning

Jun 9

Observation-driven correction of numerical weather prediction for marine winds

arXiv:2512. 03606v2 Announce Type: replace Abstract: Accurate marine wind forecasts are essential for safe navigation, ship routing, and energy operations, yet they remain challenging because observations over the ocean are sparse, heterogeneous, and temporally variable.

By Matteo Peduto, Qidong Yang, Jonathan Giezendanner, Devis Tuia, Sherrie Wang

llms rag

arXiv Machine Learning

Jun 18

Benchmarking Physics-Informed Time-Series Models for Operational Global Station Weather Forecasting

arXiv:2406. 14399v4 Announce Type: replace Abstract: The development of Time-Series Forecasting (TSF) models is often constrained by the lack of comprehensive datasets, especially in Global Station Weather Forecasting (GSWF), where existing datasets are small, temporally short, and spatially sparse.

By Tao Han, Zhibin Wen, Zhenghao Chen, Dazhao Du, Song Guo, Lei Bai

llms benchmarks safety

arXiv Machine Learning

Jun 26

Otter Weather: Skillful and Computationally Efficient Medium-Range Weather Forecasting

arXiv:2606. 26421v1 Announce Type: new Abstract: State-of-the-art medium-range AI weather models can outperform traditional Numerical Weather Prediction (NWP) but require massive training budgets.

By Cristiana Diaconu, Jonas Scholz, Aliaksandra Shysheya, Stratis Markou, Payel Mukhopadhyay, Miles Cranmer, Richard E. Turner

benchmarks

arXiv Machine Learning

Jul 1

Scaling Storm-Resolving Atmospheric AI Simulation to the Entire Planet

arXiv:2606. 31248v1 Announce Type: cross Abstract: Kilometer-scale convection shapes precipitation extremes, tropical organization, and cloud feedbacks, but most global atmospheric models approximate these processes at 25-100 km resolution.

By Zeyuan Hu, Akshay Subramaniam, Noel Keen, Tao Ge, Jaideep Pathak, Mohammad Shoaib Abbas, Suman Ravuri, Karthik Kashinath, Naser Mahfouz, Peter Caldwell, Mike Pritchard, Noah Brenowitz

llms rag

Related stories

At-the-Roofline Sparse Tensor Contractions on Vector Processors for Transformer Inference

MMOE: Modernizing Diffusion Transformers with Efficient Expert Design

Observation-driven correction of numerical weather prediction for marine winds

Benchmarking Physics-Informed Time-Series Models for Operational Global Station Weather Forecasting

Otter Weather: Skillful and Computationally Efficient Medium-Range Weather Forecasting

Scaling Storm-Resolving Atmospheric AI Simulation to the Entire Planet