← Back to all news
arXiv Machine Learning By Arjun Ashok, Mihir Parmar, Palash Goyal, Bhavana Dalvi Mishra, Chun-Liang Li, Irina Rish, Alexandre Drouin, Jinsung Yoon, Tomas Pfister

WhatIf-Bench: Benchmarking Intervention-Aware Time Series Forecasting

Read the original on arXiv Machine Learning →

WhatIf-Bench is a semi‑synthetic benchmark that tests how well time‑series forecasters use covariates to predict a target’s response to future events. It generates 37,665 tasks from mechanistic simulators of data centers, power grids, road traffic, and water networks, varying covariate numbers, historical events, and event length. Evaluation shows large‑language models outperform the best time‑series foundation models, with all models performing well on replayed events but struggling on novel covariate settings, highlighting generalization as the main challenge.

Machine-generated by The Flow from the publisher's headline and feed description — not written or checked by a human. The full article lives at arXiv Machine Learning.

Related stories

arXiv AI
Oct 9

Timer-M1: A Multivariate Time Series Foundation Model via Learning Primitives

Timer‑M1 is a pretrained multivariate time‑series foundation model that learns with primitives for zero‑shot forecasting. It uses a primitive‑based data synthesis and pretraining pipeline to generate series with shared temporal and relational patterns, assembling them into multivariate samples with distinct channel roles. The model employs gated two‑dimensional Transformer blocks that dynamically allocate cross‑variate attention, achieving top performance on several large‑scale forecasting benchmarks.

By Haoran Zhang, Haixuan Liu, Xingjian Su, Yong Liu, Zhi Chen, Yuxuan Wang, Jianmin Wang, Mingsheng Long
llmsbenchmarks
More like this →
arXiv Machine Learning
Oct 12

On the Encoding of Calendar Features in Covariate-Informed Time Series Foundation Models

The paper investigates how different calendar feature encodings influence the performance of covariate-informed time series foundation models (TSFMs). Seven encoding schemes—three target‑agnostic (ordinal, one‑hot, cyclic) and four target‑based—are systematically compared across four state‑of‑the‑art TSFMs on nine datasets that reflect social activity patterns such as weekends and holidays. Results show that encoding choice can change forecast accuracy by up to 9.9 % on non‑holidays and 83 % on holidays, with improvements mainly around holidays and varying effects across models.

By Alexander Kreusel, Maximilian Beichter, Alexandra Nikoltchovska, Benjamin Sch\"afer, Ralf Mikut, Frederik Zahn, Veit Hagenmeyer
benchmarks
More like this →