Latent Inference-Time Guidance of Time Series Foundation Models
Read the original on arXiv Machine Learning →The Flow has not summarised this story yet — read it at arXiv Machine Learning.
The Flow has not summarised this story yet — read it at arXiv Machine Learning.
arXiv:2606. 05878v1 Announce Type: new Abstract: Foundation models mark a profound paradigm shift in time series modeling, with task-specific models being superseded by general-purpose zero-shot models.
SteerCast is a retrieval‑based latent steering technique that enhances decoder‑only time‑series forecasters during inference without updating model parameters. It builds a database from the training set, storing each history window’s representation and a steering vector that captures the difference between the model’s prediction and the ground‑truth continuation in latent space. During testing, SteerCast retrieves nearest neighbors, aggregates their steering vectors, and injects the resulting signal into the forecaster’s hidden states at each autoregressive step, guiding predictions toward trajectories seen in similar training cases. Experiments on diverse multivariate benchmarks and multiple horizons demonstrate consistent accuracy improvements over fine‑tuned backbones and other retrieval‑based baselines, all while requiring no additional training beyond the original fine‑tuning and using only the training set as a retrieval corpus.
arXiv:2606. 02138v1 Announce Type: cross Abstract: Out of distribution (OOD) events in multivariate time series forecasting are rare but often dominate real world risk, making average case forecasting insufficient for reliable deployment.
arXiv:2608. 14054v1 Announce Type: new Abstract: Time series forecasting with pretrained foundation models has demonstrated strong zero-shot capabilities.
NVExplain is a model‑agnostic framework that explains time‑series forecasting by attributing each forecast horizon to temporally relevant historical lags. It models forecasting as a latent trajectory, introduces semantic flow to track information evolution, and aggregates this into a lag‑horizon attribution matrix. The method also generates structure‑preserving perturbations and fits sparse local surrogates to produce human‑readable, temporally coherent explanations, and demonstrates competitive faithfulness and stability across benchmark datasets.
Aurora‑X is a billion‑parameter time‑series foundation model designed for extreme forecasting tasks. It employs a progressive curriculum that starts with channel‑independent pretraining, then adds cross‑variable dependencies, variable context and horizon lengths, and optional future covariates during mid‑training. A variable‑resolution post‑training stage allows adjustable temporal spans per token at inference, while a pattern‑guided mixture‑of‑experts expands capacity through sparse activation and expert specialization. An implicit quantile network head predicts arbitrary quantiles, enhancing probabilistic forecasting flexibility. Experiments on GIFT‑Eval, TIME, FEV‑Bench, TFB, and DAG‑Bench show state‑of‑the‑art performance against both pretrained TSFMs and task‑specific supervised models.