arXiv Machine Learning

Retrieval Is Not Enough: Refreshing Memory for Frozen Time-Series Forecasters

arXiv AI
Sep 4

RATL: Learning from Retrieved Residuals for Robust Multivariate Time-Series Forecasting

RATL is a plug‑in method for multivariate time‑series forecasting that uses a frozen base forecaster to build a memory of its historical forecast residuals. During inference, RATL retrieves residual trajectories from similar past contexts and employs a set‑aware router to combine them, providing learned feedback correction. Experiments demonstrate that this residual‑retrieval approach improves the performance of the base forecaster across various benchmarks and backbones.

By Yuchen He, Yueyang Cang, Zhiyuan Ning, Ningyu Wang, Li Shi
arXiv Machine Learning
Aug 19

Continuous Evolution Pool: Taming Recurring Concept Drift in Online Time Series Forecasting

The paper introduces the Continuous Evolution Pool (CEP), a replay‑free framework for online time series forecasting that tackles recurring concept drift. CEP maintains a dynamic pool of specialized forecasters, using lightweight statistical genes to identify concepts, spawn new models when distribution shifts occur, and prune obsolete ones under memory limits. Experiments on real‑world datasets show CEP reduces forecasting error by up to 24% compared to state‑of‑the‑art baselines, especially in scenarios with pronounced recurring drift.

By Tianxiang Zhan, Ming Jin, Yuanpeng He, Yuxuan Liang, Shirui Pan
arXiv AI
Jun 16

TS-Memory: Plug-and-Play Memory for Time Series Foundation Models

arXiv:2602. 11550v2 Announce Type: replace-cross Abstract: Time Series Foundation Models (TSFMs) achieve strong zero-shot forecasting through large-scale pre-training, but adapting them to downstream domains under distribution shift remains challenging.

By Sisuo Lyu, Siru Zhong, Tiegang Chen, Weilin Ruan, Qingxiang Liu, Taiqiang Lv, Qingsong Wen, Raymond Chi-Wing Wong, Yuxuan Liang
arXiv Machine Learning
3d ago

Dual-Context Analog Retrieval for Time Series Forecasting

Dual-Context Analog Retrieval for Time Series Forecasting (DuoTS) introduces a two-stage forecasting approach that first generates a base forecast and then refines it patch by patch. Each refinement step fuses a current context, which focuses on recent tokens, with a detail context that incorporates retrieved analogs and their subsequent trajectories. Experiments on real-world datasets demonstrate that DuoTS achieves state‑of‑the‑art performance, and ablation studies confirm the importance of both contexts and the refinement mechanism.

By Jung Min Choi, Ngoc Son Le, Ibram Abdelmalak, Vijaya Krishna Yalavarthi, Lars Schmidt-Thieme
arXiv Machine Learning
Aug 7

Align-RAG: Alignment Is All You Need for TSFM In-Context Learning

arXiv:2608. 05571v1 Announce Type: new Abstract: Retrieval-augmented forecasting promises to adapt frozen Time Series Foundation Models (TSFMs) to new domains without fine-tuning, but recent methods typically rely on learned fusion modules, i.

By Mohammad Asadi, Soheil Hor, Bardiya Akhbari, Jack W. O'Sullivan, Tahoura Nedaee, Layne C. Price, Raviteja Anantha, Euan Ashley, Ehsan Adeli
arXiv Machine Learning
Jun 16

Not All Retrievals are Useful: Cross-Attention for Input-Aware RAG in Time Series Forecasting

arXiv:2603. 14709v2 Announce Type: replace Abstract: Retrieval-augmented generation (RAG) enhances zero-shot time series (TS) forecasting by leveraging external knowledge bases, yet existing approaches overlook input-level relevance when fusing retrieved samples with the query.

By Seunghan Lee, Jaehoon Lee, Jun Seo, Sungdong Yoo, Minjae Kim, Tae Yoon Lim, Dongwan Kang, Hwanil Choi, SoonYoung Lee, Wonbin Ahn
arXiv Machine Learning
Jun 4

Stationarity-Aware Retrieval-Augmented Time Series Forecasting

arXiv:2606. 04135v1 Announce Type: new Abstract: Time series forecasting relies on historical patterns, but real-world series often exhibit non-stationarity and regime shifts that challenge fully parametric forecasters.

By Shiqiao Zhou, Holger Sch\"oner, Zipeng Wu, Edouard Fouch\'e, IAG Wilson, Shuo Wang
arXiv Machine Learning
3d ago

On Unlearning for Time-series Forecasting

The paper introduces RDTU, a Residual Diffusion framework designed to enable efficient unlearning in time‑series forecasting models. RDTU first generates a deletion‑compatible base forecast using a retained‑set neural tangent kernel predictor, then assesses the structural support of affected windows via volume contribution metrics, and finally applies a diffusion model to produce residual corrections that approximate counterfactual forecasts. These pseudo‑labels guide a lightweight update, resulting in models that closely match those obtained by exact retraining after data deletion.

By Zeyu Shi, Yanhui Luo, Ziming Hong, Chongyang Gao, Kezhen Chen, Shanshan Ye, Lixu Wang