arXiv Machine Learning
Jun 10

One Step Closer to Ground Truth: A Multi-Scale Residual-Aware Representation Learning Pipeline for Predicting Time Series Data

arXiv:2606. 10678v1 Announce Type: new Abstract: Transformer-based models have emerged as leading paradigms in time-series forecasting in recent years, employing self-attention mechanisms to capture long-range dependencies.

By Amrijit Biswas, Mustafa Kamal, Robin Krambroeckers, M. M. Lutfe Elahi, Sifat Momen, Nabeel Mohammed, Shafin Rahman
arXiv AI
Jul 1

Mantis: Lightweight Foundation Model for Time Series Classification

arXiv:2502. 15637v2 Announce Type: replace-cross Abstract: While foundation models have revolutionized various domains, their application to time series classification remains rather under-explored, with existing literature predominantly focused on forecasting.

By Vasilii Feofanov, Songkang Wen, Shifeng Xie, Simon Roschmann, Marius Alonso, Hongbo Guo, Romain Ilbert, Malik Tiomoko, Quentin Bouniot, Zeynep Akata, Lujia Pan, Jianfeng Zhang, Ievgen Redko
arXiv Machine Learning
Nov 5

Decouple to Reuse: Fine-Grained Knowledge Augmentation for Time Series Foundation Models

arXiv:2611. 05993v1 Announce Type: new Abstract: Time series forecasting is critical for demand prediction and resource management in modern Web services, yet applying pretrained Time Series Foundation Models (TSFMs) to downstream tasks remains challenging due to domain shifts.

By Yuqian Wu, Qingxiang Liu, Yuxin Guo, Weifeng Su, Jian Li, Pengfei Xu, Xi Chen, Yutao Yue, Yuxuan Liang
arXiv Machine Learning
Oct 3

Foundations without Fundamentals: Zero-Shot Blind Spots in Time Series FMs

The paper introduces SimpleTimeBench, a diagnostic suite testing basic temporal primitives like monotonic trends, periodic signals, and leading indicator covariates. It finds that prominent multivariate Time Series Foundation Models (Chronos‑2, Moirai, and Toto) often produce suboptimal zero‑shot forecasts for these simple patterns, and that fine‑tuning can improve specific tasks while harming performance on other fundamentals. These failures persist in real‑world sensor forecasting, indicating that current TSFMs may lack the inductive biases needed to capture straightforward relationships, thereby limiting their practical reliability.

By Nafiseh Ghoroghchian, Haipeng Zhang, Shuyi Han, Alex Labach, George Stein