The article explains how transformers, which rely on self‑attention, can lose the natural order of time‑series data when fed scalar observations. It discusses the role of positional encoding in re‑introducing sequence order and provides a visual guide to illustrate this concept.
By Gurjinder Kaur
SMart is a new time series representation learning framework that combines a multi-phase recurrence plot recovery task with a source dataset selector. The recovery task uses three alternative modes to guide the encoder in capturing time series dynamics, while the selector chooses multiple suitable source datasets to augment the target dataset during pre‑training. Experiments demonstrate that SMart surpasses state‑of‑the‑art models, reducing mean absolute error by up to 19.5% in regression and increasing classification accuracy by up to 1.34%.
By Fang He, Wang-chien Lee
arXiv:2606. 26487v1 Announce Type: cross Abstract: Large language models (LLMs) are attractive for context-aware time series forecasting because they can integrate heterogeneous textual signals, yet their discrete, language-oriented tokenization and embedding interfaces are misaligned with continuous numerical values, often harming numerical ordering and forecasting reliability.
By Defu Cao, Zijie Lei, Muyan Weng, Jiao Sun, Yan Liu
arXiv:2407. 00890v5 Announce Type: replace-cross Abstract: This paper presents a comparative analysis evaluating the accuracy of Large Language Models (LLMs) against traditional macro time series forecasting approaches.
By Andrea Carriero, Davide Pettenuzzo, Shubhranshu Shekhar
arXiv:2607. 02632v1 Announce Type: cross Abstract: Time-series forecasting supports decisions in finance, en-ergy, transportation, public health, and industrial monitoring.
By Shah Nawaz Haider, Steve Austin, Arnab Barua, Sarowar Morshed Shawon, Hadaate Ullah
arXiv:2608.29579v1 Announce Type: new
Abstract: Chaotic time series forecasting is a challenging task due to its sensitivity to initial conditions and long-term unpredictability. Traditional methods...
By Yuhang Yao, Bohan Jiang
arXiv:2510. 05589v3 Announce Type: replace-cross Abstract: Effective time series forecasting enables various real-world applications, benefiting from the proliferation of mobile devices.
By Kangjia Yan, Chenxi Liu, Hao Miao, Xinle Wu, Yan Zhao, Chenjuan Guo, Bin Yang
arXiv:2601. 23204v2 Announce Type: replace Abstract: Time series data are integral to critical applications across domains such as finance, healthcare, transportation, and environmental science.
By Baoyu Jing, Sanhorn Chen, Lecheng Zheng, Boyu Liu, Zihao Li, Jiaru Zou, Tianxin Wei, Zhining Liu, Zhichen Zeng, Ruizhong Qiu, Xiao Lin, Yuchen Yan, Dongqi Fu, Jingchao Ni, Jingrui He, Hanghang Tong
KiT is a K‑line Diffusion Transformer foundation model designed for financial time‑series forecasting. It reframes future prediction as conditional path generation via flow matching, producing ensembles of plausible OHLCV trajectories from a historical context window. Trained on billions of candlestick bars across multiple markets and timescales, KiT achieves superior RankIC scores compared to task‑specific forecasters and general time‑series models.
arXiv:2508. 07195v2 Announce Type: replace-cross Abstract: Recent advances have demonstrated that Large Language Models (LLMs) can be effectively adapted for time series forecasting, revealing strong potential beyond natural language tasks.
By Yanru Sun, Emadeldeen Eldele, Zongxia Xie, Yucheng Wang, Wenzhe Niu, Qinghua Hu, Chee Keong Kwoh, Min Wu
arXiv:2607. 02437v1 Announce Type: new Abstract: Time series forecasting remains challenging when the underlying data contain rare but critical extreme events.
By Sanjeev Shrestha, Hui Liu, Yifan Zhang