The article explains how transformers, which rely on self‑attention, can lose the natural order of time‑series data when fed scalar observations. It discusses the role of positional encoding in re‑introducing sequence order and provides a visual guide to illustrate this concept.
By Gurjinder Kaur
SMart is a new time series representation learning framework that combines a multi-phase recurrence plot recovery task with a source dataset selector. The recovery task uses three alternative modes to guide the encoder in capturing time series dynamics, while the selector chooses multiple suitable source datasets to augment the target dataset during pre‑training. Experiments demonstrate that SMart surpasses state‑of‑the‑art models, reducing mean absolute error by up to 19.5% in regression and increasing classification accuracy by up to 1.34%.
By Fang He, Wang-chien Lee
arXiv:2606. 26487v1 Announce Type: cross Abstract: Large language models (LLMs) are attractive for context-aware time series forecasting because they can integrate heterogeneous textual signals, yet their discrete, language-oriented tokenization and embedding interfaces are misaligned with continuous numerical values, often harming numerical ordering and forecasting reliability.
By Defu Cao, Zijie Lei, Muyan Weng, Jiao Sun, Yan Liu
arXiv:2407. 00890v5 Announce Type: replace-cross Abstract: This paper presents a comparative analysis evaluating the accuracy of Large Language Models (LLMs) against traditional macro time series forecasting approaches.
By Andrea Carriero, Davide Pettenuzzo, Shubhranshu Shekhar
arXiv:2607. 02632v1 Announce Type: cross Abstract: Time-series forecasting supports decisions in finance, en-ergy, transportation, public health, and industrial monitoring.
By Shah Nawaz Haider, Steve Austin, Arnab Barua, Sarowar Morshed Shawon, Hadaate Ullah