arXiv AI

Dynamic Multi-Step Decoding for Time-Series Foundation Models

The paper introduces a dynamic multi‑step decoding approach for time‑series foundation models, arguing that the best decoding strategy varies by instance rather than being fixed. A lightweight selector network ranks candidate rollout schedules using the backbone’s hidden states, trained on historical windows and evaluated via dynamic programming to keep complexity quadratic. At deployment, multiple selectors vote to choose a schedule, defaulting to one‑shot decoding when they disagree, and the method shows statistically significant improvements in point‑forecast accuracy on the fev‑bench benchmark with frozen Chronos‑2 and Moirai‑1.1‑R‑small backbones.

arXiv Machine Learning
Aug 7

Align-RAG: Alignment Is All You Need for TSFM In-Context Learning

arXiv:2608. 05571v1 Announce Type: new Abstract: Retrieval-augmented forecasting promises to adapt frozen Time Series Foundation Models (TSFMs) to new domains without fine-tuning, but recent methods typically rely on learned fusion modules, i.

By Mohammad Asadi, Soheil Hor, Bardiya Akhbari, Jack W. O'Sullivan, Tahoura Nedaee, Layne C. Price, Raviteja Anantha, Euan Ashley, Ehsan Adeli
arXiv Machine Learning
Oct 12

How Much Computation Does Every Forecast Need? Structured Block Skipping in Two Time-Series Foundation Models

The paper investigates whether entire Transformer blocks can be skipped during inference in two time‑series foundation models, Chronos‑Bolt and TimesFM 2.5. By applying block‑level masks selected on calibration windows, the authors show that moderate sparsity (e.g., 7/11 blocks for Chronos‑Bolt and 16/20 for TimesFM) preserves forecasting quality while reducing latency by roughly 11–13%. However, more aggressive skipping degrades performance on certain datasets, and dynamic, input‑dependent routing remains unproven across architectures.

By Max Bourgeat
arXiv Machine Learning
Sep 22

A Hybrid Attention Model Learning Unified Time-aware Patch Representation for Irregular Multivariate Time Series Forecasting

The paper introduces a hybrid attention model that learns a unified time‑aware patch representation for irregular multivariate time series (IMTS) forecasting. It employs a time‑aware patch encoding to embed variable‑length intra‑patch timestamps, a time bias attention mechanism to adjust for temporal misalignment and asynchronous cross‑channel dependencies, and a hybrid causal mask on a decoder‑only Transformer to balance historical context with autoregressive forecasting. The authors also curate VersaTSA, a 30 B‑observation dataset preserving native sampling sparsity, and demonstrate state‑of‑the‑art zero‑shot performance on three IMTS benchmarks while remaining competitive on regular MTS tasks.

By Zhihao Lin, Li Lin, Qi Zhang, Kaiwen Xia, Shuai Wang, Jialin Qiao
arXiv AI
Oct 9

ROAR: Retrieval Opportunity-Aware Refinement for Zero-Shot Time Series Forecasting

ROAR is a Retrieval Opportunity-Aware Refinement framework designed for zero-shot time series forecasting. It enhances predictions by weighting queries according to base-forecast difficulty and the improvement potential of retrieved historical candidates, then learning a gate to control correction strength. The method jointly calibrates the forecasting module and gate, anchoring the final prediction to an initial refined output, and achieves the lowest average MSE across seven benchmarks compared to other methods.

By Jinjin Chi, Lei Feng, Yiming Wang, Lulu Zhang, Yongcheng Jing, Chenyi Li, Ximing Li