arXiv Machine Learning

Season-Aware Hybrid Convolutional-Transformer for Antarctic Sea Ice Concentration Forecasting

The paper presents a hybrid Convolutional‑Transformer model for forecasting Antarctic sea ice concentration (SIC) on a monthly basis. It combines convolutional encoding for spatial features with factorised self‑attention to capture spatio‑temporal dependencies, and introduces two seasonal prior mechanisms: a month‑aware positional encoding and a seasonal temporal bias. Experiments show the model outperforms convolutional and recurrent baselines, with ablation studies confirming the benefits of the seasonal priors for both short‑ and long‑horizon predictions.

arXiv AI
Jun 30

UniMamba: A Unified Spatial-Temporal Modeling Framework with State-Space and Attention Integration

arXiv:2604. 16325v3 Announce Type: replace-cross Abstract: Multivariate time series forecasting is fundamental to numerous domains such as energy, finance, and environmental monitoring, where complex temporal dependencies and cross-variable interactions pose enduring challenges.

By Xingsheng Chen, Xianpei Mu, Deyu Yi, Yilin Yuan, Xingwei He, Bo Gao, Regina Zhang, Pietro Lio, Siu-Ming Yiu
arXiv Machine Learning
Sep 18

SETTer: Sparse-Encoder Transformer for Long-term Multivariate Time Series Forecasting

SETTer is a transformer-based model designed for long‑term multivariate time‑series forecasting. It introduces decoupled self‑attention and hybrid masking to better handle high dimensionality and complex relationships, while adding explainable structures to highlight discriminative patterns. Experiments on real‑world benchmarks show that SETTer outperforms state‑of‑the‑art models in 88% of scenarios.

By Abraham Ezema, Chijioke Eze, Ferdinanda Ponci, Antonello Monti
Hugging Face Trending Papers
Sep 17

SETTer: Sparse-Encoder Transformer for Long-term Multivariate Time Series Forecasting

SETTer is a transformer-based model designed for long‑term multivariate time‑series forecasting. It introduces decoupled self‑attention and hybrid masking to better capture short‑ and long‑term patterns across time and channel dimensions, while adding simple explainable structures to highlight discriminative patterns. Experiments on real‑world benchmarks show that a single‑layer SETTer outperforms state‑of‑the‑art models in 88% of scenarios.

arXiv Machine Learning
Sep 22

Gaussian Process Decorrelation for Spatiotemporal Deep Learning-Based Snow Water Equivalent Prediction

The paper proposes a method for predicting future snow water equivalent (SWE) across the Western United States by first removing spatial correlations using a Gaussian Process-based linear transformation, then training a long short-term memory (LSTM) neural network on the decorrelated data. This separation of spatial and temporal components improves predictive accuracy compared to baseline models. Additionally, the authors incorporate conformal prediction to provide distribution‑free uncertainty estimates for SWE forecasts.

By Colin Fenster, Adrienne Marshall, Soutir Bandyopadhyay, Daniel McKenzie