arXiv Machine Learning
Oct 28

STeP-TS: Shared Temporal Filters with Pruning for Time Series

The paper introduces STeP-TS, a compact one‑layer convolutional model for multivariate time‑series forecasting that learns a shared bank of multi‑scale temporal filters for each variable. Lightweight variable‑specific scalar weights modulate the contribution of each filter, allowing the model to capture both shared temporal patterns and variable‑specific dynamics. The learned weights and filter‑output energy are used for structured pruning, reducing computational complexity with minimal loss in performance, and an amplitude‑adaptive normalization preserves variable‑dependent temporal amplitudes.

By Hanne Raum, Jasper Hoffmann, Joschka Boedecker
arXiv Machine Learning
Sep 18

SETTer: Sparse-Encoder Transformer for Long-term Multivariate Time Series Forecasting

SETTer is a transformer-based model designed for long‑term multivariate time‑series forecasting. It introduces decoupled self‑attention and hybrid masking to better handle high dimensionality and complex relationships, while adding explainable structures to highlight discriminative patterns. Experiments on real‑world benchmarks show that SETTer outperforms state‑of‑the‑art models in 88% of scenarios.

By Abraham Ezema, Chijioke Eze, Ferdinanda Ponci, Antonello Monti
arXiv AI
Aug 25

NeST: Neighborhood-aware semantic alignment and temporal modulation for LLM based time series forecasting

NeST is a framework that adapts large language models (LLMs) for continuous time‑series forecasting by creating neighborhood‑aware text prototypes and aligning them with temporal representations through a nearest‑neighbor contrastive objective. It retrieves the most relevant prototypes and uses them to conditionally modulate time‑series features, enabling more effective integration of textual and temporal information. Experiments show that NeST outperforms state‑of‑the‑art methods on eight benchmarks, reduces MSE by 1.2% for long‑term forecasting, improves zero‑shot forecasting by 4.9%, and boosts R² by 3.3% on a real‑world photovoltaic power forecasting task.

By Jayanie Bogahawatte, Sachith Seneviratne, Maneesha Perera, Saman Halgamuge