arXiv Machine Learning By Hanyang Jiang, Rina Foygel Barber, Ashwin Pananjady, Yao Xie

Leave a Window Out: Modifying the Jackknife for Predictive Inference in Time Series

Read the original on arXiv Machine Learning →

arXiv:2605. 30292v2 Announce Type: replace-cross Abstract: Conformal prediction methods enjoy strong theoretical and empirical predictive inference performance, provided the data is exchangeable and is treated symmetrically during training.

Machine-generated by The Flow from the publisher's headline and feed description — not written or checked by a human. The full article lives at arXiv Machine Learning.

arXiv Machine Learning
Sep 24

Rolling Conformal Prediction in Sequential Model Training

Rolling Conformal Prediction (rolling‑CP) is a distribution‑free predictive inference method designed for sequential model training. It calibrates each incoming observation against the current predictor and incorporates it into future training, eliminating the need for data splitting. For exchangeable data, rolling‑CP guarantees marginal coverage with a universal factor‑two bound, and for i.i.d. streams it provides high‑probability training‑conditional validity over time, improving to the target level under stability conditions.

By Chen Cheng, Ruiting Liang, Rina Foygel Barber
arXiv AI
Aug 19

SPACE: Sample-cloud Predictive Adaptive Conformal Ellipsoids for Multivariate Time-Series Forecasting

SPACE is a conformal wrapper that creates ellipsoidal joint prediction regions for multivariate time‑series forecasts by estimating time‑local covariance directly from the current forecast sample cloud. It calibrates the region’s radius using a dynamic backward window‑selection scheme, avoiding reliance on historical residuals. Experiments on diverse datasets show that SPACE improves joint and rolling coverage, achieving better coverage‑efficiency tradeoffs than existing wrappers.

By Baishi Li, Kelvin J. L. Koa, Ke-Wei Huang
arXiv AI
Aug 19

Beyond MSE: Rethinking the Evaluation Metric and Benchmarking for Irregular Time Series Forecasting

The paper critiques the prevalent use of mean squared error (MSE) for evaluating irregular time‑series forecasting, arguing that MSE is biased by timestamp sampling distributions. It introduces the Continuous‑time Squared Error (CSE), an importance‑weighted metric that theoretically offers a tighter asymptotic bound on continuous‑time risk than MSE. A comprehensive benchmark across synthetic, semi‑synthetic, and eight real‑world datasets demonstrates that CSE more accurately recovers continuous‑time risk, revealing limitations of relying solely on MSE.

By Rongwen Li, Haixin Xie, Xiao Wang, Changjian Chen