arXiv Machine Learning

Can Deep Neural Networks Improve Compression of Very Large Scientific Data?

arXiv:2606. 14353v1 Announce Type: new Abstract: Error-bounded lossy compression is a fundamental technique for managing the rapidly growing volumes of scientific data produced by modern simulations and observational instruments.

arXiv Machine Learning
Sep 22

Neural Residual Modeling for Scientific Data Compression under Guaranteed Error Bounds

The paper introduces a new compression pipeline for scientific simulation data that combines Residual Vector Quantization (RVQ) with a U‑Net post‑processing network to correct pixel‑space residuals, followed by a Guaranteed Autoencoder (GAE) that enforces block‑wise error bounds. The U‑Net is trained to predict spatially structured residuals, addressing limitations of latent‑space only approaches. Experiments on S3D, JHTDB, and E3SM datasets show improved NRMSE and compression ratios compared to RVQ alone while maintaining strict error guarantees.

By Surya Majumder, Liangji Zhu, Sanjay Ranka, Anand Rangarajan
arXiv Machine Learning
Aug 28

SimCast-S2S: An Efficient Generative Model for Subseasonal Precipitation Forecasting via Transfer Learning from Climate Simulations

SimCast‑S2S is a generative latent‑diffusion model designed for probabilistic subseasonal‑to‑seasonal precipitation forecasting. It tackles three key challenges: it uses a diffusion pipeline to capture uncertainty, operates in a compact latent space to enable efficient large‑ensemble generation, and leverages transfer learning with low‑rank adaptation to train on limited reanalysis data after pretraining on climate simulations. The model outperforms deep‑learning baselines and competes with, or surpasses, operational systems such as the ECMWF‑S2S baseline without requiring extensive post‑processing.

By Hiep V. Dang, Antonios Mamalakis
arXiv Machine Learning
Sep 4

SimCast-S2S: A Computationally Efficient Diffusion Model for Subseasonal Precipitation Forecasting

SimCast‑S2S is a generative latent‑diffusion framework designed for probabilistic subseasonal‑to‑seasonal precipitation forecasting. It tackles three key challenges: it uses a diffusion‑based generative pipeline for uncertainty quantification, operates in a compact latent space learned by VAEs for efficient large‑ensemble generation, and employs transfer learning with LoRA to overcome limited training data. On reanalysis data, it outperforms deep‑learning baselines and competes with or surpasses state‑of‑the‑art operational systems such as ECMWF‑S2S.

By Hiep V. Dang, Antonios Mamalakis
arXiv Machine Learning
Sep 2

GenONet: A Generative operator Network for High-Resolution Precipitation Nowcasting

GenONet introduces a Spatio-Temporal U-DeepONet architecture that serves as a generator in a GAN framework for high‑resolution precipitation nowcasting up to three hours ahead. By learning continuous‑time precipitation dynamics with a Deep Operator Network and enforcing physics through a moisture‑conservation loss, the model produces sharp, physically consistent forecasts that outperform baselines, especially for high‑intensity events and longer lead times. Ablation studies confirm the added value of the physics‑informed regularizer and the synergy of operator learning with adversarial training.

By Mohammad Kian Golkar, Luciano Alves de Oliveira, Mohammad Khanjani
arXiv Machine Learning
Aug 20

An Empirical Benchmark of Deep Time-Series Models for Smart Meter Energy Forecasting

The paper presents an empirical benchmark of nine modern deep‑learning models for time‑series forecasting of smart‑meter energy consumption, evaluated on two publicly available datasets. It examines how historical input length, prediction horizon, and model architecture affect accuracy, finding that longer historical context improves performance up to a saturation point and that accuracy declines with longer horizons. The study also compares computational complexity, showing that lightweight architectures achieve similar performance to heavier models, and notes that model choice has limited impact across most demographic and household subgroups.

By Behnaz Kavoosighafi, Maria Eidenskog, Wiktoria Glad, Katerina Vrotsou
arXiv Machine Learning
Aug 19

Evaluating and improving crop-yield forecasting methods during extreme drought

The study evaluates crop‑yield forecasting methods for the 2012 Midwestern US drought, comparing non‑deep learning machine learning models with a deep learning model (VITA) using 16 meteorological predictors. It highlights challenges such as distributional dissimilarity between training and test data, spatial and temporal sparsity, and demonstrates that sample weighting and feature selection improve non‑deep learning models but not VITA. The work contrasts deep versus non‑deep learning approaches and shows how modifications can mitigate issues arising from extreme drought conditions.

By Shrey Gupta, Yi Ming, George Mohler