arXiv Machine Learning

The Unused Input: The Initial State as a Conditioning Interface for Recurrent TSFMs

The paper investigates whether the initial recurrent state in time‑series foundation models (TSFMs) can be leveraged to improve forecasting accuracy. Using the xLSTM‑based zero‑shot forecaster TiRex, the authors freeze the backbone and train a small head that writes a context vector into the initial state, demonstrating modest but consistent gains across several datasets. The study shows that the initial state can serve both as a per‑dataset adaptation surface and as a channel for exogenous information, suggesting a new avenue for enhancing recurrent TSFMs.

arXiv AI
1d ago

FlexCast: Flexible Context Learning for Time Series Foundation Models

FlexCast introduces a flexible context-target learning framework for time series foundation models, reformulating forecasting as variable-length masked prediction over time series patches. By dynamically sampling visible context and masked target patches during pretraining, it exposes the model to diverse context-target configurations without sequential decoding. The same pretrained model can perform one-step forecasting, confidence-based iterative refinement, and next-token-style generation, achieving competitive or superior accuracy to strong TSFM baselines while reducing inference latency.

By Zuyang Shen, Luqi Gong, Fanda Fan, Bingsong Wang, Xiang Ao, Yahui Wei, Minghao Liu, Chunjie Luo, Jianfeng Zhan
arXiv Machine Learning
Sep 22

A Hybrid Attention Model Learning Unified Time-aware Patch Representation for Irregular Multivariate Time Series Forecasting

The paper introduces a hybrid attention model that learns a unified time‑aware patch representation for irregular multivariate time series (IMTS) forecasting. It employs a time‑aware patch encoding to embed variable‑length intra‑patch timestamps, a time bias attention mechanism to adjust for temporal misalignment and asynchronous cross‑channel dependencies, and a hybrid causal mask on a decoder‑only Transformer to balance historical context with autoregressive forecasting. The authors also curate VersaTSA, a 30 B‑observation dataset preserving native sampling sparsity, and demonstrate state‑of‑the‑art zero‑shot performance on three IMTS benchmarks while remaining competitive on regular MTS tasks.

By Zhihao Lin, Li Lin, Qi Zhang, Kaiwen Xia, Shuai Wang, Jialin Qiao
arXiv AI
Oct 21

Training-Free Continual Learning for Multimodal Forecasting via Prompt Evolution

The paper proposes a training‑free continual learning approach for multimodal time‑series forecasting by evolving a textual guidance block that is appended to a frozen large language model’s prompt. On a benchmark combining weekly search indices, daily currencies, and daily commodities with web‑retrieved news, the evolved 900‑word guidance outperforms existing time‑series foundation models and transfers to newer models without loss, while requiring only monetary cost rather than GPU days. The authors also show that compiling the guidance into executable code recovers most of the gain deterministically and that the advantage grows at short horizons, with news text being distilled into policy during learning.

By Laurent Mombaerts, Jonathan Taws, Jacopo Gargano, Dinesh Gaddam, Kevin George, Srijan Tiwari, Shreyas Rajesh