arXiv Machine Learning

When Attention Does Not Explain the Peak: Temporal Reference vs. Forecast Output in Attention-Based Time-Series Forecasting

arXiv AI
3d ago

KITE: A Knowledge-Injected Temporal Encoder for Time-Series Event Forecasting

KITE is a knowledge‑injected temporal encoder that augments self‑supervised event forecasting with semantic priors supplied by system engineers. It uses two switchable mechanisms—a covariate mechanism and an attention‑bias mechanism—so the same architecture can incorporate different prior types without per‑dataset tuning. Experiments show that informative priors improve performance in short contexts and enable out‑of‑domain transfer, while priors already present in the observed window have little effect.

By Jonas Petersen, Pratik Jawahar, Riccardo Maggioni, Gian-Alessandro Lombardi, Matteo Cozzi, Marek Gajewski, Federico Martelli, Camilla Mazzoleni, Philipp Christian Petersen
arXiv AI
Jul 10

What LLM Forecasters Know but Don't Say: Probing Internal Representations for Calibration and Faithfulness

arXiv:2607. 08046v1 Announce Type: cross Abstract: Large language models fine-tuned for forecasting can be accurate yet poorly calibrated, and their chain-of-thought (CoT) reasoning may not faithfully reflect the evidence behind a forecast.

By Rapha\"el Sarfati, Pratyush Ranjan Tiwari, Siddharth Boppana, Christopher J. Earls, Srikar Varadaraj, Eric Ho
Hugging Face Trending Papers
Jul 6

AIFS-SUBS: Extending Data-Driven Forecasting to Sub-Seasonal Timescales

Data-driven models now rival numerical weather prediction in the medium range, but extending them to sub-seasonal lead times raises challenges absent at shorter horizons. Errors accumulate over long autoregressive rollouts, systematic biases grow with lead time, and several years of data must be held out for independent verification, even though machine-learning models otherwise benefit from longer training records.

arXiv AI
Jun 18

A Hybrid LSTM--Vision Transformer Architecture for Predicting HRRR Forecast Errors

arXiv:2606. 19026v1 Announce Type: cross Abstract: Forecast errors in high-resolution numerical weather prediction (NWP) systems are often linked to unresolved planetary boundary layer (PBL) processes, convection, terrain-induced circulations, and other vertically structured atmospheric phenomena.

By David Aaron Evans, Jay C. Rothenberger, Kara J. Sulia, Nick P. Bassill, Chris D. Thorncroft
arXiv Machine Learning
Sep 14

Explaining Time Series Forecasting with Horizon-Resolved Attribution

The paper introduces Horizon-Resolved eXplanation (HRX), a framework that adds a horizon axis to time‑series forecasting explanations, allowing each forecast step to have its own importance map. HRX operates as a plug‑in for any differentiable forecaster, includes an evaluation protocol that tests the impact of removing top‑ranked inputs, and a rank criterion to decide when horizon resolution is beneficial. Experiments across multiple backbones and datasets demonstrate that incorporating the horizon axis improves explanation quality and that the step‑wise dependence is low‑dimensional, requiring only a few shared maps regardless of forecast length.

By Seunghan Lee, Jun Seo, Jaehoon Lee, Junhyeok Kang, Sangjun Han, Sungdong Yoo, Minjae Kim, Tae Yoon Lim, Dongwan Kang, Hwanil Choi, Soonyoung Lee, Wonbin Ahn