arXiv AI By Zuyang Shen, Luqi Gong, Fanda Fan, Bingsong Wang, Xiang Ao, Yahui Wei, Minghao Liu, Chunjie Luo, Jianfeng Zhan

FlexCast: Flexible Context Learning for Time Series Foundation Models

Read the original on arXiv AI →

FlexCast introduces a flexible context-target learning framework for time series foundation models, reformulating forecasting as variable-length masked prediction over time series patches. By dynamically sampling visible context and masked target patches during pretraining, it exposes the model to diverse context-target configurations without sequential decoding. The same pretrained model can perform one-step forecasting, confidence-based iterative refinement, and next-token-style generation, achieving competitive or superior accuracy to strong TSFM baselines while reducing inference latency.

Machine-generated by The Flow from the publisher's headline and feed description — not written or checked by a human. The full article lives at arXiv AI.

arXiv Machine Learning
6d ago

The Unused Input: The Initial State as a Conditioning Interface for Recurrent TSFMs

The paper investigates whether the initial recurrent state in time‑series foundation models (TSFMs) can be leveraged to improve forecasting accuracy. Using the xLSTM‑based zero‑shot forecaster TiRex, the authors freeze the backbone and train a small head that writes a context vector into the initial state, demonstrating modest but consistent gains across several datasets. The study shows that the initial state can serve both as a per‑dataset adaptation surface and as a channel for exogenous information, suggesting a new avenue for enhancing recurrent TSFMs.

By Bernhard Voggenberger, Christian Ganh\"or, Levente Z\'olyomi, Sebastian B\"ock, Sepp Hochreiter
arXiv Machine Learning
Sep 29

Aurora-X: Built for Extreme Time Series Forecasting

Aurora‑X is a billion‑parameter time‑series foundation model designed for extreme forecasting tasks. It employs a progressive curriculum that starts with channel‑independent pretraining, then adds cross‑variable dependencies, variable context and horizon lengths, and optional future covariates during mid‑training. A variable‑resolution post‑training stage allows adjustable temporal spans per token at inference, while a pattern‑guided mixture‑of‑experts expands capacity through sparse activation and expert specialization. An implicit quantile network head predicts arbitrary quantiles, enhancing probabilistic forecasting flexibility. Experiments on GIFT‑Eval, TIME, FEV‑Bench, TFB, and DAG‑Bench show state‑of‑the‑art performance against both pretrained TSFMs and task‑specific supervised models.

By Xingjian Wu, Chenjuan Guo, Xiangfei Qiu, Zhigang Hu, Hanyin Cheng, Peng Chen, Yang Shu, Jilin Hu, Bin Yang
Hugging Face Trending Papers
Sep 28

Instance-Adaptive Prompts as Context for Time-Series Foundation Models

The paper introduces PaCTS, a method that generates instance‑adaptive latent prompts—continuous embedding tokens—to provide compact contextual information for frozen time‑series foundation models (TSFMs). These prompts are constructed from instance‑specific global statistics and refined with segment‑level temporal data, enabling the model to capture both global characteristics and local temporal variations. Experiments show that PaCTS improves forecasting performance across various context lengths and model architectures, often outperforming the same backbone with double the context while reducing inference computation, and it also offers stronger improvements and better out‑of‑distribution generalization compared to weight‑space adaptation methods.