arXiv Machine Learning

Betting on Moments: Legendre Jumper Martingales for Online Exchangeability Testing

arXiv:2606. 20859v2 Announce Type: replace-cross Abstract: A fundamental assumption in statistics and machine learning is that ``the future looks like the past,'' formalized as exchangeability: the joint data distribution is order-invariant.

arXiv Machine Learning
Jul 13

Global Sequential Testing for Multi-Stream Auditing

arXiv:2602. 21479v3 Announce Type: replace-cross Abstract: Across many risk-sensitive areas, it is critical to continuously audit machine learning systems as we receive more data to quickly determine if they are performing as designed.

By Beepul Bharti, Ambar Pal, Jeremias Sulam
arXiv Machine Learning
Sep 24

Rolling Conformal Prediction in Sequential Model Training

Rolling Conformal Prediction (rolling‑CP) is a distribution‑free predictive inference method designed for sequential model training. It calibrates each incoming observation against the current predictor and incorporates it into future training, eliminating the need for data splitting. For exchangeable data, rolling‑CP guarantees marginal coverage with a universal factor‑two bound, and for i.i.d. streams it provides high‑probability training‑conditional validity over time, improving to the target level under stability conditions.

By Chen Cheng, Ruiting Liang, Rina Foygel Barber
arXiv Statistics ML
Aug 25

Change Detection in Probability Flow ODE: Online Testing in Diffusion Latent Spaces

The paper introduces a sequential change‑point detection method for time‑ordered data where neither the pre‑ nor post‑change distributions have closed forms. It trains a conditional diffusion model on pre‑change data, uses its probability flow ODE to map observations to a Gaussian latent space, and then applies the Maximum Mean Discrepancy as a test statistic. The authors derive closed‑form components under the Gaussian null, establish the statistic’s asymptotic distribution as a degenerate U‑statistic, and implement an online Shiryaev–Roberts procedure with exact threshold calibration to detect arbitrary distributional shifts without parametric assumptions.

By Artem Kraevskiy, Artem Prokhorov