The paper introduces a hybrid attention model that learns a unified time‑aware patch representation for irregular multivariate time series (IMTS) forecasting. It employs a time‑aware patch encoding to embed variable‑length intra‑patch timestamps, a time bias attention mechanism to adjust for temporal misalignment and asynchronous cross‑channel dependencies, and a hybrid causal mask on a decoder‑only Transformer to balance historical context with autoregressive forecasting. The authors also curate VersaTSA, a 30 B‑observation dataset preserving native sampling sparsity, and demonstrate state‑of‑the‑art zero‑shot performance on three IMTS benchmarks while remaining competitive on regular MTS tasks.
By Zhihao Lin, Li Lin, Qi Zhang, Kaiwen Xia, Shuai Wang, Jialin Qiao
arXiv:2508. 07195v2 Announce Type: replace-cross Abstract: Recent advances have demonstrated that Large Language Models (LLMs) can be effectively adapted for time series forecasting, revealing strong potential beyond natural language tasks.
By Yanru Sun, Emadeldeen Eldele, Zongxia Xie, Yucheng Wang, Wenzhe Niu, Qinghua Hu, Chee Keong Kwoh, Min Wu
arXiv:2607. 07640v1 Announce Type: cross Abstract: Deep learning has significantly advanced time series imputation, yet most existing architectures primarily rely on localized temporal context within the corrupted input sequence.
By Xuan-Thong Truong, Trung-Kien Le, Tung Kieu, Thi-Thu Nguyen, Nhat-Hai Nguyen
The paper introduces DNBNet, a Debiased Neural Basis-Function Network designed for irregular time series forecasting. It addresses two main limitations of existing methods: asymptotic bias from ignoring timestamp sampling density and limited adaptability of predefined basis functions. DNBNet employs importance sampling to correct bias, neural‑network parameterized basis functions for flexibility, a multi‑scale decomposition with mass‑aware fusion for sparse data, and a dual‑branch decoder, achieving strong performance across diverse real‑world datasets.
By Rongwen Li, Changjian Chen
arXiv:2608. 06223v1 Announce Type: new Abstract: While deep learning models, particularly transformer-based architectures, have shown impressive performance in time series forecasting, the application of retrieval-augmented generation (RAG) in this domain remains limited.
By Yixiong Xiao, Congxi Xiao, Jingbo Zhou
arXiv:2511. 20577v5 Announce Type: replace Abstract: Real-world time series often exhibit strong non-stationarity, complex nonlinear dynamics, and behavior expressed across multiple temporal scales, from rapid local fluctuations to slow-evolving long-range trends.
By Sumit S Shevtekar, Chandresh K Maurya
The paper introduces PaCTS, a method that generates instance‑adaptive latent prompts—continuous embedding tokens—to provide compact contextual information for frozen time‑series foundation models (TSFMs). These prompts are constructed from instance‑specific global statistics and refined with segment‑level temporal data, enabling the model to capture both global characteristics and local temporal variations. Experiments show that PaCTS improves forecasting performance across various context lengths and model architectures, often outperforming the same backbone with double the context while reducing inference computation, and it also offers stronger improvements and better out‑of‑distribution generalization compared to weight‑space adaptation methods.
QUALS is a large‑scale time‑series corpus equilibrium framework designed to improve data efficiency for zero‑shot forecasting. It uses pattern quantization to decode heterogeneous patterns from mixed corpora and a learnability synchronization mechanism to calibrate sampling weights, bridging the optimization gap between simple and complex motifs. Benchmarks show that pre‑training on QUALS yields superior zero‑shot performance even with reduced training budgets.
By Yujie Li, Zezhi Shao, Chengqing Yu, Yisong Fu, Weijie Zhu, Yifan Du, Jilin Hu, Bin Yang, Yongjun Xu, Fei Wang
NeST is a framework that adapts large language models (LLMs) for continuous time‑series forecasting by creating neighborhood‑aware text prototypes and aligning them with temporal representations through a nearest‑neighbor contrastive objective. It retrieves the most relevant prototypes and uses them to conditionally modulate time‑series features, enabling more effective integration of textual and temporal information. Experiments show that NeST outperforms state‑of‑the‑art methods on eight benchmarks, reduces MSE by 1.2% for long‑term forecasting, improves zero‑shot forecasting by 4.9%, and boosts R² by 3.3% on a real‑world photovoltaic power forecasting task.
By Jayanie Bogahawatte, Sachith Seneviratne, Maneesha Perera, Saman Halgamuge
arXiv:2607. 28035v1 Announce Type: new Abstract: Irregular multivariate time series are widely encountered in applications such as healthcare monitoring, human activity recognition, and environmental sensing.
By Tianen Shen, Zhengyu Li, Yutong Li, Xiangfei Qiu, Xingjian Wu, Bin Yang, Jilin Hu
arXiv:2508. 05287v3 Announce Type: replace-cross Abstract: Existing time series foundation models (TSFMs), often based on transformer variants, lack adaptability to different sampling rates, struggle with generalization across varying context and target lengths, and are computationally inefficient.
By Lars Graf, Thomas Ortner, Stanis{\l}aw Wo\'zniak, Angeliki Pantazi
arXiv:2607. 19404v1 Announce Type: cross Abstract: Multivariate time series encode structural patterns that unfold across multiple temporal scales, yet most forecasting backbones treat learned representations as transient byproducts of prediction, leaving the organizational geometry of these patterns underexploited.
By Xingsheng Chen, Deyu Yi, Siu-Ming Yiu