arXiv Machine Learning

When to Trust Memory: Retrieval-Guided Probabilistic Spatiotemporal Forecasting under Distribution Shift

arXiv AI
Jun 16

TS-Memory: Plug-and-Play Memory for Time Series Foundation Models

arXiv:2602. 11550v2 Announce Type: replace-cross Abstract: Time Series Foundation Models (TSFMs) achieve strong zero-shot forecasting through large-scale pre-training, but adapting them to downstream domains under distribution shift remains challenging.

By Sisuo Lyu, Siru Zhong, Tiegang Chen, Weilin Ruan, Qingxiang Liu, Taiqiang Lv, Qingsong Wen, Raymond Chi-Wing Wong, Yuxuan Liang
arXiv Machine Learning
Aug 19

Continuous Evolution Pool: Taming Recurring Concept Drift in Online Time Series Forecasting

The paper introduces the Continuous Evolution Pool (CEP), a replay‑free framework for online time series forecasting that tackles recurring concept drift. CEP maintains a dynamic pool of specialized forecasters, using lightweight statistical genes to identify concepts, spawn new models when distribution shifts occur, and prune obsolete ones under memory limits. Experiments on real‑world datasets show CEP reduces forecasting error by up to 24% compared to state‑of‑the‑art baselines, especially in scenarios with pronounced recurring drift.

By Tianxiang Zhan, Ming Jin, Yuanpeng He, Yuxuan Liang, Shirui Pan
arXiv Machine Learning
Jul 2

TRIE: An Evaluation Framework for Stochastic PDE Surrogates

arXiv:2607. 00196v1 Announce Type: new Abstract: Many scientific systems exhibit uncertainty from stochastic forcing, unresolved degrees of freedom, or imperfect observations, making reliable surrogate forecasting fundamentally distributional rather than pointwise.

By Bharat Srikishan, Javier E. Santos, Nikhil Muralidhar, Charles D. Young
arXiv Machine Learning
Oct 2

Proper Scoring Rule-based Diffusion for Probabilistic Weather Forecasting

The paper introduces a new diffusion-based approach for probabilistic weather forecasting that incorporates auxiliary conditional denoising tasks. By predicting future states from both clean and corrupted contexts, the model reduces ambiguity and learns conditional distributions across noise levels using a proper scoring rule. Experiments demonstrate improved one‑step forecasting, especially at longer horizons, and better calibration in high‑dimensional global weather scenarios.

By Joonhyeong Park, Giung Nam, Hyungi Lee, Kyunghyun Cho, Byoungwoo Park, Juho Lee
arXiv Machine Learning
Sep 29

Aurora-X: Built for Extreme Time Series Forecasting

Aurora‑X is a billion‑parameter time‑series foundation model designed for extreme forecasting tasks. It employs a progressive curriculum that starts with channel‑independent pretraining, then adds cross‑variable dependencies, variable context and horizon lengths, and optional future covariates during mid‑training. A variable‑resolution post‑training stage allows adjustable temporal spans per token at inference, while a pattern‑guided mixture‑of‑experts expands capacity through sparse activation and expert specialization. An implicit quantile network head predicts arbitrary quantiles, enhancing probabilistic forecasting flexibility. Experiments on GIFT‑Eval, TIME, FEV‑Bench, TFB, and DAG‑Bench show state‑of‑the‑art performance against both pretrained TSFMs and task‑specific supervised models.

By Xingjian Wu, Chenjuan Guo, Xiangfei Qiu, Zhigang Hu, Hanyin Cheng, Peng Chen, Yang Shu, Jilin Hu, Bin Yang
arXiv Machine Learning
Jun 4

Stationarity-Aware Retrieval-Augmented Time Series Forecasting

arXiv:2606. 04135v1 Announce Type: new Abstract: Time series forecasting relies on historical patterns, but real-world series often exhibit non-stationarity and regime shifts that challenge fully parametric forecasters.

By Shiqiao Zhou, Holger Sch\"oner, Zipeng Wu, Edouard Fouch\'e, IAG Wilson, Shuo Wang