arXiv Machine Learning

How Much Computation Does Every Forecast Need? Structured Block Skipping in Two Time-Series Foundation Models

The paper investigates whether entire Transformer blocks can be skipped during inference in two time‑series foundation models, Chronos‑Bolt and TimesFM 2.5. By applying block‑level masks selected on calibration windows, the authors show that moderate sparsity (e.g., 7/11 blocks for Chronos‑Bolt and 16/20 for TimesFM) preserves forecasting quality while reducing latency by roughly 11–13%. However, more aggressive skipping degrades performance on certain datasets, and dynamic, input‑dependent routing remains unproven across architectures.

Hugging Face Trending Papers
Jun 25

How Good Can Linear Models Be for Time-Series Forecasting?

Time-series forecasting research has been moving steadily toward larger architectures, from specialized transformers to general-purpose foundation models, on the assumption that capacity is what unlocks accuracy. We take the opposite position: most of the gap can be closed at far lower cost by tuning preprocessing rather than scaling models.

arXiv Machine Learning
Sep 15

FlowTSFM: Turning Encoder Depth into Quantile Transport

arXiv:2609.13640v1 Announce Type: new Abstract: Encoder-based time series foundation models (TSFMs) typically rely on deep stacks of independently parameterized Transformer layers, where only the fin...

By Bahaeddine Abdessalem, Shifeng Xie, Zehao Xiao, Youssef Attia El Hili, Ambroise Odonnat, Jianfeng Zhang, Lujia Pan, Keli Zhang, Malik Tiomoko
arXiv Machine Learning
Oct 8

Are We Really Benchmarking Forecasting Models? The Impact of Preprocessing on Time Series Performance

The paper investigates how preprocessing choices influence time‑series forecasting performance. By evaluating 11 models across 16 reversible preprocessing pipelines on 29,000 M4 series, it shows that optimizing preprocessing can improve accuracy by 27% to 87%, especially for models without built‑in preprocessing. This demonstrates that simpler architectures can rival complex state‑of‑the‑art models when preprocessing is properly handled.

By Guilherme Afonso Galindo Padilha, Paulo Salgado Gomes de Mattos Neto, Rafael Menelau Oliveira e Cruz
arXiv Machine Learning
Jun 18

Benchmarking Physics-Informed Time-Series Models for Operational Global Station Weather Forecasting

arXiv:2406. 14399v4 Announce Type: replace Abstract: The development of Time-Series Forecasting (TSF) models is often constrained by the lack of comprehensive datasets, especially in Global Station Weather Forecasting (GSWF), where existing datasets are small, temporally short, and spatially sparse.

By Tao Han, Zhibin Wen, Zhenghao Chen, Dazhao Du, Song Guo, Lei Bai