The article explains how to detect subtle changes in the relationships between features—known as data drift—using adversarial validation techniques and scikit‑learn tools. It focuses on situations where individual feature distributions appear unchanged, yet the underlying interactions shift, potentially degrading model performance. The post provides practical guidance on implementing these methods to maintain model reliability.
arXiv:2606. 20216v1 Announce Type: cross Abstract: Machine learning algorithms deployed for evolving streaming environments must handle the non-stationary data distributions, commonly referred to as concept drift.
arXiv:2606. 07789v1 Announce Type: new Abstract: Data stream mining is fundamentally challenged by concept drift, where distributional changes can degrade model performance.
MORA is a drift‑robust time‑series anomaly detection framework that addresses the ambiguity between distribution drift and true anomalies by defining a temporal change disambiguation problem. It reconstructs a local target from paired short‑ and long‑term views, using the reconstruction gap as a measure of contextual support to adjust the primary anomaly score. The method requires no drift annotations or online adaptation and demonstrates strong robustness to non‑stationarity while maintaining sensitivity to genuine anomalies on four TSAD benchmarks.
arXiv:2608. 19767v1 Announce Type: cross Abstract: Skchange is an open-source Python library for detecting structural changes in time series.
arXiv:2607. 17336v1 Announce Type: new Abstract: Drift detection is a core component of production machine learning monitoring systems, where detectors are used to compare incoming data with a reference distribution and trigger alerts when changes occur.
skchange is an open‑source Python library that provides fast and flexible algorithms for detecting structural changes in time series. It offers modular, composable methods based on cost minimisation and statistical tests, and includes features such as anomalous segment detection, high‑dimensional data support, automatic penalty calibration, and a wide range of built‑in costs and tests. The library follows scikit‑learn conventions and uses Numba for high computational performance, with source code and documentation available on GitHub.
arXiv:2606. 27832v1 Announce Type: new Abstract: Statistical adversarial detection (SAD) treats detection as a two-sample test.
arXiv:2607. 23924v1 Announce Type: cross Abstract: Vision foundation models have enabled strong training-free anomaly detection (AD).
Vision foundation models have enabled strong training-free anomaly detection (AD). However, most existing approaches rely primarily on independent local patch features, leaving the global contextual information encoded by Vision Transformers (ViTs) underexploited.
arXiv:2608. 13465v1 Announce Type: cross Abstract: Concept drift refers to changes over time in the statistical properties of data, as compared to the data that was used to train a learning model.
arXiv:2608.23723v1 Announce Type: new Abstract: Few-shot anomaly detection (FSAD) has recently benefited from vision-language models such as CLIP, which enable anomaly de?tection by aligning visual f...
The paper addresses the problem of evaluating deployed machine learning models when their input data distribution shifts, which can arise from changes in the underlying population or from data integrity issues in the feature pipeline. It proposes an online model‑testing framework that reproduces the detected shift on a controlled baseline with known labels, distinguishing between the two mechanisms of shift to estimate current performance and potential gains from repairing data integrity problems. Experiments on real‑world datasets with simulated faults demonstrate that separating the two sources of shift generally improves performance estimates, and a churn‑prediction case study shows how these tests can guide monitoring and repair prioritization.