A Framework for Evaluating and Benchmarking Concept Drift Detection Methods
arXiv:2606. 07789v1 Announce Type: new Abstract: Data stream mining is fundamentally challenged by concept drift, where distributional changes can degrade model performance.
The paper introduces the Stream Cruise Control Method (SCCM), a framework for detecting and adapting to concept drift in online regression. SCCM performs early-response drift detection, quantifies drift magnitude, applies KPI-window-based thresholding to reduce false alarms, dynamically tunes hyperparameters, and recalibrates models, all within an in-memory design for real-time operation. Evaluations on synthetic and real-world datasets demonstrate that SCCM improves predictive performance compared to eight baseline detector–adaptation methods.
arXiv:2606. 07789v1 Announce Type: new Abstract: Data stream mining is fundamentally challenged by concept drift, where distributional changes can degrade model performance.
arXiv:2606. 20216v1 Announce Type: cross Abstract: Machine learning algorithms deployed for evolving streaming environments must handle the non-stationary data distributions, commonly referred to as concept drift.
arXiv:2608. 19488v1 Announce Type: new Abstract: Production machine learning systems degrade under concept drift, yet practitioners have little principled guidance on when to retrain.
AdaptLSTM is an adaptive online learning framework designed for cloud workload forecasting under distribution drift. It detects drift using validation‑calibrated thresholds and performs selective, targeted updates, achieving a large portion of the accuracy gains of naive online learning while reducing per‑step compute cost. Experiments on Alibaba and Container traces show significant efficiency improvements and error reductions compared to static models and classical drift detectors.
arXiv:2610.17399v1 Announce Type: cross Abstract: Continuous monitoring of generative AI systems requires detecting distribution shifts in the unstructured data they ingest and generate. Existing mon...
The paper introduces AIGS, a lightweight Adaptive Incremental Gating System designed for online representation learning in non‑stationary data streams. AIGS uses a Shock Ratio feedback signal to drive a Continuous Plasticity Controller, enabling smooth adaptation between learning plasticity and memory retention while keeping per‑step complexity linear in the feature dimension. Experiments on smart‑city traffic, meteorological, and industrial datasets show that AIGS improves early‑warning lead times, accelerates recovery after abrupt changes, and enhances anomaly recall in noisy environments.
arXiv:2608. 02845v1 Announce Type: new Abstract: Tabular model performance degrades when feature distributions change over time or the relationship between features and outcome variables change over time, known as data drift and concept drift, respectively.
arXiv:2606. 09430v1 Announce Type: cross Abstract: Online task-free continual learning (TFCL) requires intelligent agents to sequentially accumulate knowledge from an unbounded, non-stationary data stream under strict single-pass constraints and without any explicit task identifiers.
The paper investigates when online adaptation benefits edge time‑series forecasting under distribution drift, using a leakage‑free streaming protocol on six public multivariate datasets. It shows that the warmup budget for static baselines and the choice of learning rate can bias perceived adaptation gains, and that a validation‑only procedure selecting warmup and optimizer rates yields Adam outperforming SGD with momentum in most settings. The study also examines accuracy versus adaptation‑state memory and per‑update latency for different adaptation strategies, highlighting parameter‑efficient variants that are nondominated on the memory axis.
arXiv:2505. 04608v5 Announce Type: replace-cross Abstract: Responsibly deploying artificial intelligence (AI) / machine learning (ML) systems in high-stakes settings arguably requires not only proof of system reliability, but also continual, post-deployment monitoring to quickly detect and address any unsafe behavior.
The paper introduces the Continuous Evolution Pool (CEP), a replay‑free framework for online time series forecasting that tackles recurring concept drift. CEP maintains a dynamic pool of specialized forecasters, using lightweight statistical genes to identify concepts, spawn new models when distribution shifts occur, and prune obsolete ones under memory limits. Experiments on real‑world datasets show CEP reduces forecasting error by up to 24% compared to state‑of‑the‑art baselines, especially in scenarios with pronounced recurring drift.
The paper introduces PAI-KNN, a k‑nearest neighbor classifier designed for data stream classification with concept drift and class imbalance. Unlike traditional methods that modify memory through instance removal or resampling, PAI‑KNN keeps a simple sliding‑window buffer and adapts its decision rule at inference time by adjusting class priors based on recent observations. Experiments on synthetic streams with varying imbalance and drift show that PAI‑KNN performs competitively with state‑of‑the‑art techniques, especially when dynamic class imbalance and concept drift are present.