arXiv AI

Learning to Detect Shifts in Unstructured Data Streams via Monitoring-by-Betting

arXiv AI
4d ago

Hitting a Moving Target: Test-Time Adaptation for AI Text Detection under Continual Distribution Shift

The paper introduces a test‑time adaptation (TTA) method for AI text detection that addresses continual distribution shifts such as adversarial humanization, new large language models, and temporal drift in human writing. By exploiting inference‑time homogeneity among unlabeled samples, the TTA approach achieves robust performance, outperforming state‑of‑the‑art supervised detectors—e.g., improving detection of adversarial AI‑generated text from 27.0% to 93.3%. The study demonstrates that TTA can maintain high detection accuracy in real‑world, evolving deployment scenarios.

By Kevin Ren, Manish Raghavan, Nikhil Garg
arXiv AI
Sep 11

SCCM : Stream Cruise Control Method for Automated Drift Detection and Adaptation

The paper introduces the Stream Cruise Control Method (SCCM), a framework for detecting and adapting to concept drift in online regression. SCCM performs early-response drift detection, quantifies drift magnitude, applies KPI-window-based thresholding to reduce false alarms, dynamically tunes hyperparameters, and recalibrates models, all within an in-memory design for real-time operation. Evaluations on synthetic and real-world datasets demonstrate that SCCM improves predictive performance compared to eight baseline detector–adaptation methods.

By Mohammad Abu-Shaira, Weishi Shi
arXiv Computation and Language
Aug 27

Adaptive Triggering for Bias Correction in LLM Reasoning

The paper introduces an adaptive triggering mechanism for bias correction in large language model (LLM) reasoning. By framing bias intervention as an online change‑point detection problem, the authors update a CUSUM statistic at each step using either a white‑box next‑token probability signal or a black‑box LLM judge signal, and inject corrective prompts only when the accumulated evidence exceeds a calibrated threshold. Experiments on gpt‑4o‑mini and six open‑weight models show that adaptive black‑box triggering restores most of the accuracy lost by fixed‑interval interventions while reducing the number of corrections, whereas the white‑box signal improves ambiguous‑item accuracy but can hurt disambiguated‑item accuracy due to difficulty distinguishing stereotype reliance from correct evidence.

By Nayoung Kim, Mickey Mancenido, Huan Liu
arXiv Machine Learning
Oct 8

MORA: Modeling Observed Changes for Drift-Robust Time-Series Anomaly Detection

MORA is a drift‑robust time‑series anomaly detection framework that addresses the ambiguity between distribution drift and true anomalies by defining a temporal change disambiguation problem. It reconstructs a local target from paired short‑ and long‑term views, using the reconstruction gap as a measure of contextual support to adjust the primary anomaly score. The method requires no drift annotations or online adaptation and demonstrates strong robustness to non‑stationarity while maintaining sensitivity to genuine anomalies on four TSAD benchmarks.

By Xudong Mou, Tiejun Wang, Rui Wang, Hui Wang, Pin Liu, Tianyu Wo, Xudong Liu, Renyu Yang
Hugging Face Trending Papers
Jul 5

Measuring Harness-Induced Belief Divergence in Multi-Step LLM Agents

Software-agent benchmarks usually report whether an agent solves a task, but the agent reaches that outcome through a harness that controls what it sees, which actions it can take, which failures are repaired, which states are verified, and which evidence is logged. We show that this harness can change the agent's multi-step beliefs even when the task, environment, and base LLM are fixed.