arXiv Machine Learning August 18, 2026 By Jie Deng

Distribution-free false-alarm calibration and chance-corrected spatial evaluation for industrial anomaly detection

Read the original on arXiv Machine Learning →

arXiv:2608. 15090v1 Announce Type: cross Abstract: Studies of industrial visual inspection commonly report the area under the receiver operating characteristic curve (AUROC) and the overlap between anomaly maps and defect masks.

Summary generated by The Flow from the publisher's feed. The full article lives at arXiv Machine Learning.

arXiv Machine Learning

Jun 15

Conformal calibration and look-elsewhere effect in anomaly detection for new-physics searches

arXiv:2606. 13780v1 Announce Type: cross Abstract: Machine-learned anomaly detection is reshaping searches for new physics, but it has outrun the statistics used to interpret it.

By Jack Y. Araz, Michael Spannowsky

arXiv Machine Learning

Jun 24

Anticipating the Optimism Gap: Predicting Distribution-Shift Degradation of RF-Impairment Detectors from In-Distribution Statistics

arXiv:2606. 22054v2 Announce Type: replace-cross Abstract: Detectors for GNSS radio-frequency impairments (jamming, spoofing, multipath) are usually reported with a single AUC measured on the distribution they were tuned on.

By Chakshu Baweja

arXiv Machine Learning

5d ago

Excess Separability: Nuisance-Controlled Residual-Stream Probing for Benchmark Contamination Detection

arXiv:2608. 12652v1 Announce Type: cross Abstract: Benchmark contamination is diagnosed today with n-gram overlap, with likelihood-based membership inference, or with canary strings, and each needs something usually unavailable: the training corpus, a well-chosen test statistic, or foresight at dataset release.

By Florian Braun

llms benchmarks

arXiv AI

Aug 11

When Is Benchmark Contamination Detectable? Information Limits and Power-Calibrated Audits

arXiv:2608. 07914v1 Announce Type: new Abstract: Behavioral contamination detectors can return "no evidence" either because a benchmark is clean or because the audit has little power.

By Ibne Farabi Shihab, Sanjeda Akter, Anuj Sharma

benchmarks

arXiv Machine Learning

Jul 15

Rough Path Signature-Guided Geometry Augmentation for Few-Shot Industrial Surface Defect Detection

arXiv:2607. 12245v1 Announce Type: cross Abstract: Few-shot industrial defect detection remains difficult for standard supervised detectors, which achieve poor performance on boundary-dominated industrial defects.

By Jiaqi Kuang

arXiv AI

Jun 19

Calibration Without Comprehension: Diagnosing the Limits of Fine-Tuning LLMs for Vulnerability Detection in Systems Software

arXiv:2606. 20502v1 Announce Type: cross Abstract: Whether LLMs scoring well on vulnerability benchmarks genuinely reason about security or merely pattern-match on contaminated data remains unresolved.

By Arastoo Zibaeirad, Marco Vieira

llms fine-tuning benchmarks

Related stories

Conformal calibration and look-elsewhere effect in anomaly detection for new-physics searches

Anticipating the Optimism Gap: Predicting Distribution-Shift Degradation of RF-Impairment Detectors from In-Distribution Statistics

Excess Separability: Nuisance-Controlled Residual-Stream Probing for Benchmark Contamination Detection

When Is Benchmark Contamination Detectable? Information Limits and Power-Calibrated Audits

Rough Path Signature-Guided Geometry Augmentation for Few-Shot Industrial Surface Defect Detection

Calibration Without Comprehension: Diagnosing the Limits of Fine-Tuning LLMs for Vulnerability Detection in Systems Software