arXiv AI
Learning to Detect Shifts in Unstructured Data Streams via Monitoring-by-Betting
Read the original on arXiv AI →The Flow has not summarised this story yet — read it at arXiv AI.
Related stories
arXiv AI
Aug 18
WATCH: Adaptive Monitoring for AI Deployments via Weighted-Conformal Martingales
arXiv:2505. 04608v5 Announce Type: replace-cross Abstract: Responsibly deploying artificial intelligence (AI) / machine learning (ML) systems in high-stakes settings arguably requires not only proof of system reliability, but also continual, post-deployment monitoring to quickly detect and address any unsafe behavior.
arXiv AI
Jun 9
LargeMonitor: Monitoring Online Task-Free Continual Learning via Large Pretrained Models
arXiv:2606. 09430v1 Announce Type: cross Abstract: Online task-free continual learning (TFCL) requires intelligent agents to sequentially accumulate knowledge from an unbounded, non-stationary data stream under strict single-pass constraints and without any explicit task identifiers.
arXiv AI
4d ago
Hitting a Moving Target: Test-Time Adaptation for AI Text Detection under Continual Distribution Shift
The paper introduces a test‑time adaptation (TTA) method for AI text detection that addresses continual distribution shifts such as adversarial humanization, new large language models, and temporal drift in human writing. By exploiting inference‑time homogeneity among unlabeled samples, the TTA approach achieves robust performance, outperforming state‑of‑the‑art supervised detectors—e.g., improving detection of adversarial AI‑generated text from 27.0% to 93.3%. The study demonstrates that TTA can maintain high detection accuracy in real‑world, evolving deployment scenarios.
arXiv Machine Learning
Sep 22
High-Dimensional Online Change Point Detection with Adaptive Thresholding and Interpretability
arXiv:2609.24278v1 Announce Type: new Abstract: Change point detection (CPD) identifies abrupt and significant changes in sequential data, with applications in human activity recognition, financial m...
arXiv Machine Learning
Jun 9
A Framework for Evaluating and Benchmarking Concept Drift Detection Methods
arXiv:2606. 07789v1 Announce Type: new Abstract: Data stream mining is fundamentally challenged by concept drift, where distributional changes can degrade model performance.
arXiv AI
Sep 11
SCCM : Stream Cruise Control Method for Automated Drift Detection and Adaptation
The paper introduces the Stream Cruise Control Method (SCCM), a framework for detecting and adapting to concept drift in online regression. SCCM performs early-response drift detection, quantifies drift magnitude, applies KPI-window-based thresholding to reduce false alarms, dynamically tunes hyperparameters, and recalibrates models, all within an in-memory design for real-time operation. Evaluations on synthetic and real-world datasets demonstrate that SCCM improves predictive performance compared to eight baseline detector–adaptation methods.