arXiv Machine Learning

Latent-Regime Bias Auditing for Volatility Forecasting

arXiv:2608. 01599v1 Announce Type: new Abstract: Volatility forecasts are commonly evaluated with aggregate accuracy metrics such as RMSE and MAE, but these metrics can hide conditional failures that matter for risk management.

arXiv AI
Sep 24

Loss Choice or Model Choice? The Role of Forecast Level in Cryptocurrency Volatility Forecasting

The paper investigates how the choice of loss function versus the choice of forecasting model affects cryptocurrency volatility predictions. By comparing seven loss functions and five models, and aligning forecast levels before evaluation, the study finds that after level adjustment model choice dominates performance differences, while loss-induced variations largely disappear. The work clarifies that apparent loss effects in raw comparisons are largely due to forecast level differences rather than intrinsic model performance.

By Andrzej Tokajuk, Jaros{\l}aw A. Chudziak
arXiv AI
Aug 5

FinVerse: Financial Time-Series Benchmark

arXiv:2608. 03259v1 Announce Type: cross Abstract: As time-series foundation models have emerged, the need for benchmarks that can evaluate their forecasting ability in meaningful ways has become increasingly important.

By Jaehoon Lee, Jun Seo, Seunghan Lee, Tae Yoon Lim, Dongwan Kang, Hwanil Choi, Minjae Kim, Sungdong Yoo, Junhyeok Kang, Sangjun Han, Soonyoung Lee, Wonbin Ahn
arXiv AI
Aug 19

Beyond MSE: Rethinking the Evaluation Metric and Benchmarking for Irregular Time Series Forecasting

The paper critiques the prevalent use of mean squared error (MSE) for evaluating irregular time‑series forecasting, arguing that MSE is biased by timestamp sampling distributions. It introduces the Continuous‑time Squared Error (CSE), an importance‑weighted metric that theoretically offers a tighter asymptotic bound on continuous‑time risk than MSE. A comprehensive benchmark across synthetic, semi‑synthetic, and eight real‑world datasets demonstrates that CSE more accurately recovers continuous‑time risk, revealing limitations of relying solely on MSE.

By Rongwen Li, Haixin Xie, Xiao Wang, Changjian Chen
Hugging Face Trending Papers
Jun 1

ProbRes: Volatility Learning for Probabilistic Time-Series Forecasting

Probabilistic time series forecasting has attracted increasing attention in financial applications due to the need to quantify risk and uncertainty in future observations. We propose ProbRes, a post-hoc probabilistic calibration method that explicitly learns and incorporates volatility dynamics into probabilistic forecasting, enabling effective handling of heteroskedastic data.

arXiv AI
Aug 17

Forecast Collapse in Time-Series Foundation Models

arXiv:2608. 14106v1 Announce Type: cross Abstract: When forecasting hourly returns for 1,000 US equities, we observe an unexpected phenomenon: predictions become nearly flat and show poor stock ranking, as measured by cross-sectional correlation.

By Shu Wan, Miles Ma, Hank Zhu, Guangqi Liu, Stephen Wang, Qingsong Wen, Huan Liu