Timer‑M1 is a pretrained multivariate time‑series foundation model that learns with primitives for zero‑shot forecasting. It uses a primitive‑based data synthesis and pretraining pipeline to generate series with shared temporal and relational patterns, assembling them into multivariate samples with distinct channel roles. The model employs gated two‑dimensional Transformer blocks that dynamically allocate cross‑variate attention, achieving top performance on several large‑scale forecasting benchmarks.
By Haoran Zhang, Haixuan Liu, Xingjian Su, Yong Liu, Zhi Chen, Yuxuan Wang, Jianmin Wang, Mingsheng Long
The paper investigates whether the initial recurrent state in time‑series foundation models (TSFMs) can be leveraged to improve forecasting accuracy. Using the xLSTM‑based zero‑shot forecaster TiRex, the authors freeze the backbone and train a small head that writes a context vector into the initial state, demonstrating modest but consistent gains across several datasets. The study shows that the initial state can serve both as a per‑dataset adaptation surface and as a channel for exogenous information, suggesting a new avenue for enhancing recurrent TSFMs.
By Bernhard Voggenberger, Christian Ganh\"or, Levente Z\'olyomi, Sebastian B\"ock, Sepp Hochreiter
arXiv:2605. 28166v3 Announce Type: replace-cross Abstract: Irregular Multivariate Time Series (IMTS) are common in practice, yet their irregular sampling complicates effective modeling.
By Junghoon Lim
arXiv:2405. 16440v2 Announce Type: replace-cross Abstract: In recent years, Transformers have become the de-facto architecture for long-term time series forecasting (LTSF), yet they face challenges associated with the self-attention mechanism, including quadratic complexity and permutation-invariant bias.
By Xiuding Cai, Xueyao Wang, Yaoyao Zhu, Yu Yao
Irregular multivariate time series forecasting (IMTSF) requires capturing temporal dynamics and cross-variable dependencies from sparse, asynchronous observations. Existing methods often rely on learn...
arXiv:2607. 02344v1 Announce Type: cross Abstract: Transformer architectures have shown strong potential in time series forecasting, where multi-head self-attention is widely used to capture temporal dependencies across historical timestamps.
By Dezheng Wang, Tong Chen, Wei Yuan, Congyan Chen, Shihua Li, Hongzhi Yin