arXiv Machine Learning By Tajamul Ashraf, Janibul Bashir

FATE: Focal-modulated Attention Encoder for Multivariate Time-series Forecasting

Read the original on arXiv Machine Learning →

arXiv:2408. 11336v3 Announce Type: replace Abstract: Climate change stands as one of the most pressing global challenges of the twenty-first century, with far-reaching consequences such as rising sea levels, melting glaciers, and increasingly extreme weather patterns.

Machine-generated by The Flow from the publisher's headline and feed description — not written or checked by a human. The full article lives at arXiv Machine Learning.

arXiv Machine Learning
Sep 18

SETTer: Sparse-Encoder Transformer for Long-term Multivariate Time Series Forecasting

SETTer is a transformer-based model designed for long‑term multivariate time‑series forecasting. It introduces decoupled self‑attention and hybrid masking to better handle high dimensionality and complex relationships, while adding explainable structures to highlight discriminative patterns. Experiments on real‑world benchmarks show that SETTer outperforms state‑of‑the‑art models in 88% of scenarios.

By Abraham Ezema, Chijioke Eze, Ferdinanda Ponci, Antonello Monti
arXiv Machine Learning
Sep 1

Season-Aware Hybrid Convolutional-Transformer for Antarctic Sea Ice Concentration Forecasting

The paper presents a hybrid Convolutional‑Transformer model for forecasting Antarctic sea ice concentration (SIC) on a monthly basis. It combines convolutional encoding for spatial features with factorised self‑attention to capture spatio‑temporal dependencies, and introduces two seasonal prior mechanisms: a month‑aware positional encoding and a seasonal temporal bias. Experiments show the model outperforms convolutional and recurrent baselines, with ablation studies confirming the benefits of the seasonal priors for both short‑ and long‑horizon predictions.

By Danyang Li, John Taylor, Thang Bui, Quanling Deng
arXiv AI
Jun 30

UniMamba: A Unified Spatial-Temporal Modeling Framework with State-Space and Attention Integration

arXiv:2604. 16325v3 Announce Type: replace-cross Abstract: Multivariate time series forecasting is fundamental to numerous domains such as energy, finance, and environmental monitoring, where complex temporal dependencies and cross-variable interactions pose enduring challenges.

By Xingsheng Chen, Xianpei Mu, Deyu Yi, Yilin Yuan, Xingwei He, Bo Gao, Regina Zhang, Pietro Lio, Siu-Ming Yiu