arXiv Machine Learning July 15, 2026 By Zongye Lyu

Did We Actually Fix It? An Independent Adversarial Stress-Test of Post-Point-Adjustment Evaluation Metrics for Time-Series Anomaly Detection

Read the original on arXiv Machine Learning →

arXiv:2607. 11969v1 Announce Type: cross Abstract: Point-adjustment (PA), long the default scoring protocol in time-series anomaly detection (TSAD), was shown by Kim et al.

Machine-generated by The Flow from the publisher's headline and feed description — not written or checked by a human. The full article lives at arXiv Machine Learning.

arXiv Machine Learning

Sep 22

Measuring the Checker: Mutation Analysis for GPU-Kernel Benchmark Oracles

The paper introduces mutation analysis as a metric for evaluating GPU‑kernel benchmark oracles, injecting over ten thousand faults into verified CUDA implementations of 188 KernelBench problems. It shows that the current official checkers miss 16.9% of faults, with precision faults being especially problematic, and demonstrates that optimized test suites can achieve 98% detection with only two inputs per problem. The study also reveals flaws in existing patches and a fuzzing recipe that incorrectly rejects correct kernels 107 times.

By Mingzhe Du, Anh Tuan Luu, Dong Huang, See-Kiong Ng

llms benchmarks

arXiv AI

Jun 16

Auditing Reward Hackability in Code RL Training Environments

arXiv:2606. 16062v1 Announce Type: new Abstract: We measure the rate at which code RL environments accept incorrect solutions as correct.

By Shreshth Rajan

llms reinforcement-learning

arXiv Machine Learning

Sep 22

Probe-Geometry Alignment: Erasing the Cross-Sequence Memorization Signature Below Chance

arXiv:2605.01699v4 Announce Type: replace Abstract: Recent attacks show that behavioural unlearning of large language models leaves internal traces recoverable by adversarial probes. We characterise...

By Anamika Paul Rupa, Anietie Andy

llms fine-tuning benchmarks safety

arXiv Machine Learning

Jun 10

What Demonstration Curation Metrics Do to Your Policy

arXiv:2606. 10229v1 Announce Type: cross Abstract: We study whether demonstration-curation metrics that detect defective training episodes also improve the downstream behavior-cloning policy that trains on the curated data.

By Aarav Bedi

benchmarks

arXiv AI

Jun 19

Calibration Without Comprehension: Diagnosing the Limits of Fine-Tuning LLMs for Vulnerability Detection in Systems Software

arXiv:2606. 20502v1 Announce Type: cross Abstract: Whether LLMs scoring well on vulnerability benchmarks genuinely reason about security or merely pattern-match on contaminated data remains unresolved.

By Arastoo Zibaeirad, Marco Vieira

llms fine-tuning benchmarks

arXiv AI

Aug 6

Just Repair: A Minimal Denoising Network for Time Series Anomaly Detection

arXiv:2604. 17388v3 Announce Type: replace-cross Abstract: Time series anomaly detectors have grown steadily more complex, incorporating attention mechanisms, adversarial training, and stochastic latent variables.

By Kadir-Kaan \"Ozer, Ren\'e Ebeling, Markus Enzweiler

benchmarks safety

One email a morning, machine-written

Related stories

Measuring the Checker: Mutation Analysis for GPU-Kernel Benchmark Oracles

Auditing Reward Hackability in Code RL Training Environments

Probe-Geometry Alignment: Erasing the Cross-Sequence Memorization Signature Below Chance

What Demonstration Curation Metrics Do to Your Policy

Calibration Without Comprehension: Diagnosing the Limits of Fine-Tuning LLMs for Vulnerability Detection in Systems Software

Just Repair: A Minimal Denoising Network for Time Series Anomaly Detection