Towards Data Science

Measuring Structure Stability of Econometric Models

The simplest most important idea for time series forecasting The post Measuring Structure Stability of Econometric Models appeared first on Towards Data Science .

arXiv Machine Learning
Aug 24

When Does Forecasting Reveal Temporal Structure? A Stability Analysis of Time-Series Structural Selection

The paper investigates when forecasting accuracy can reliably reveal the underlying temporal structure of a time series. It shows that a small forecast margin does not automatically mean structural ambiguity and introduces a stability-based measure that assesses how well different temporal mechanisms can be distinguished given uncertainty in the selection objective. Experiments demonstrate that this stability metric better predicts when forecast-only structural selection succeeds or fails compared to relying solely on forecast margin.

By Qipeng Qian, Yuntao Qian
Towards Data Science
Sep 25

Your Model's MSE Is Lying to You: Part II

The article discusses how to handle uncertainty in probabilistic forecasting for physical signals, focusing on autoregressive rollout and uncertainty propagation. It is the second part of a series titled "Your Model's MSE Is Lying to You," which explores the limitations of mean squared error in evaluating predictive models. The post was published on Towards Data Science.

By Waleed Esmail
arXiv AI
Sep 25

SGA: Uncertainty Quantification for Multi-Step Forecasting in Time Series Foundation Models

The paper introduces SGA, a method for quantifying uncertainty in multi‑step forecasts from Time Series Foundation Models (TSFMs). SGA models all possible forecast branches as a directed acyclic graph, using the graph’s complexity—derived from topology and TSFM stochasticity—to bound and measure uncertainty. Experiments on 11 TSFMs across 27 datasets show that SGA outperforms existing uncertainty‑quantification methods, offers broader sampling coverage, and reveals that larger TSFMs tend to produce lower uncertainty estimates.

By Xin-Yu Hu, Shuang Liang, Cheng Feng, Shao-Qun Zhang
arXiv Machine Learning
Aug 18

Macroeconomic Forecasting with Large Language Models

arXiv:2407. 00890v5 Announce Type: replace-cross Abstract: This paper presents a comparative analysis evaluating the accuracy of Large Language Models (LLMs) against traditional macro time series forecasting approaches.

By Andrea Carriero, Davide Pettenuzzo, Shubhranshu Shekhar
arXiv AI
Jul 14

SciML in the Wild: A Diagnostic Study of When Structural Priors Help and When They Hurt

arXiv:2607. 09684v1 Announce Type: cross Abstract: Scientific Machine Learning (SciML) methods such as Neural Ordinary Differential Equations (NODEs), Physics-Informed Neural Networks (PINNs), and Universal Differential Equations (UDEs) are most effective when structural priors reflect reliable governing dynamics.

By Vrishank Sai Anand, Prathamesh Dinesh Joshi, Raj Abhijit Dandekar, Rajat Dandekar, Sreedath Panat