arXiv AI

FlexCast: Flexible Context Learning for Time Series Foundation Models

FlexCast introduces a flexible context-target learning framework for time series foundation models, reformulating forecasting as variable-length masked prediction over time series patches. By dynamically sampling visible context and masked target patches during pretraining, it exposes the model to diverse context-target configurations without sequential decoding. The same pretrained model can perform one-step forecasting, confidence-based iterative refinement, and next-token-style generation, achieving competitive or superior accuracy to strong TSFM baselines while reducing inference latency.

arXiv Machine Learning
6d ago

The Unused Input: The Initial State as a Conditioning Interface for Recurrent TSFMs

The paper investigates whether the initial recurrent state in time‑series foundation models (TSFMs) can be leveraged to improve forecasting accuracy. Using the xLSTM‑based zero‑shot forecaster TiRex, the authors freeze the backbone and train a small head that writes a context vector into the initial state, demonstrating modest but consistent gains across several datasets. The study shows that the initial state can serve both as a per‑dataset adaptation surface and as a channel for exogenous information, suggesting a new avenue for enhancing recurrent TSFMs.

By Bernhard Voggenberger, Christian Ganh\"or, Levente Z\'olyomi, Sebastian B\"ock, Sepp Hochreiter
arXiv Machine Learning
Sep 29

Aurora-X: Built for Extreme Time Series Forecasting

Aurora‑X is a billion‑parameter time‑series foundation model designed for extreme forecasting tasks. It employs a progressive curriculum that starts with channel‑independent pretraining, then adds cross‑variable dependencies, variable context and horizon lengths, and optional future covariates during mid‑training. A variable‑resolution post‑training stage allows adjustable temporal spans per token at inference, while a pattern‑guided mixture‑of‑experts expands capacity through sparse activation and expert specialization. An implicit quantile network head predicts arbitrary quantiles, enhancing probabilistic forecasting flexibility. Experiments on GIFT‑Eval, TIME, FEV‑Bench, TFB, and DAG‑Bench show state‑of‑the‑art performance against both pretrained TSFMs and task‑specific supervised models.

By Xingjian Wu, Chenjuan Guo, Xiangfei Qiu, Zhigang Hu, Hanyin Cheng, Peng Chen, Yang Shu, Jilin Hu, Bin Yang
Hugging Face Trending Papers
Sep 28

Instance-Adaptive Prompts as Context for Time-Series Foundation Models

The paper introduces PaCTS, a method that generates instance‑adaptive latent prompts—continuous embedding tokens—to provide compact contextual information for frozen time‑series foundation models (TSFMs). These prompts are constructed from instance‑specific global statistics and refined with segment‑level temporal data, enabling the model to capture both global characteristics and local temporal variations. Experiments show that PaCTS improves forecasting performance across various context lengths and model architectures, often outperforming the same backbone with double the context while reducing inference computation, and it also offers stronger improvements and better out‑of‑distribution generalization compared to weight‑space adaptation methods.

arXiv AI
Oct 9

AdaCast: Conditional Parameter Generation for Adaptive Time Series Forecasting

AdaCast introduces a conditional parameter generation framework that tailors time‑series forecasting models to each input by producing low‑rank updates for a frozen pretrained foundation model. Unlike static adaptation methods that apply a single set of updates to all inputs, AdaCast generates input‑specific updates during both training and inference. Experiments on six public benchmarks show that AdaCast consistently outperforms static baselines in in‑domain forecasting and improves zero‑shot generalization to unseen datasets across domains.

By Darahaas Nallagatla, Darryl Cherian Jacob, Pan He
arXiv Machine Learning
Nov 5

Decouple to Reuse: Fine-Grained Knowledge Augmentation for Time Series Foundation Models

arXiv:2611. 05993v1 Announce Type: new Abstract: Time series forecasting is critical for demand prediction and resource management in modern Web services, yet applying pretrained Time Series Foundation Models (TSFMs) to downstream tasks remains challenging due to domain shifts.

By Yuqian Wu, Qingxiang Liu, Yuxin Guo, Weifeng Su, Jian Li, Pengfei Xu, Xi Chen, Yutao Yue, Yuxuan Liang
arXiv Machine Learning
Sep 24

A Foundation Model for Instruction-Conditioned In-Context Time Series Tasks

The paper introduces iAmTime, a time‑series foundation model that uses instruction‑conditioned in‑context learning to adapt to tasks at inference time. iAmTime represents each episode as a structured prompt with semantic tokens that focus on specific time‑series regions, enabling the model to infer task structure from input‑output demonstrations. Trained on large real and synthetic corpora across forecasting, imputation, reconstruction, classification, anomaly detection, and source de‑mixing, iAmTime outperforms strong baselines on zero‑shot probabilistic and point forecasting while matching or exceeding performance on several non‑forecasting tasks.

By Anish Saha, Konstantin Shmakov
arXiv Machine Learning
Oct 5

Dual-Context Analog Retrieval for Time Series Forecasting

Dual-Context Analog Retrieval for Time Series Forecasting (DuoTS) introduces a two-stage forecasting approach that first generates a base forecast and then refines it patch by patch. Each refinement step fuses a current context, which focuses on recent tokens, with a detail context that incorporates retrieved analogs and their subsequent trajectories. Experiments on real-world datasets demonstrate that DuoTS achieves state‑of‑the‑art performance, and ablation studies confirm the importance of both contexts and the refinement mechanism.

By Jung Min Choi, Ngoc Son Le, Ibram Abdelmalak, Vijaya Krishna Yalavarthi, Lars Schmidt-Thieme