arXiv Machine Learning June 11, 2026 By Laurence A. Jacobs

A prior-free blind detection of information leakage from model predictions

Read the original on arXiv Machine Learning →

arXiv:2606. 11267v1 Announce Type: new Abstract: Data leakage -- contamination of a model with information unavailable at baseline -- is the dominant reproducibility failure in machine-learning-based science, yet detection tools require training code, external data, or domain expertise.

Summary generated by The Flow from the publisher's feed. The full article lives at arXiv Machine Learning.

arXiv Machine Learning

Aug 5

Temporal Leakage in LLM Backtesting: Measurement, Validation, and Adjusted Scores

arXiv:2608. 02985v1 Announce Type: new Abstract: The standard check for contamination in LLM backtests is simple: compare scores before and after the training cutoff.

By Zeyu Zhang, Bradly C. Stadie

llms

arXiv AI

Jun 3

The Reliability Gap in Benchmark Auditing: Distribution Shift and Scale as Failure Modes of Contamination Detection

arXiv:2606. 03305v1 Announce Type: new Abstract: Benchmark contamination, where evaluation examples appear in a model's training data, threatens the validity of LLM assessment.

By Wojciech Zarzecki, Jan Dubi\'nski, Sebastian Cygert

llms benchmarks

arXiv Machine Learning

Aug 5

Evaluation Blindness: How Silent Measurement Failures Corrupt AI Systems from Training to Deployment

arXiv:2608. 02786v1 Announce Type: new Abstract: AI systems can fail silently.

By Priyanka Bajaj (Independent Researcher)

llms fine-tuning benchmarks

arXiv Machine Learning

Jun 16

False Sense of Safety in Selective Signal Classification: Auditing Bound Tightness and Exchangeability for Risk Control

arXiv:2606. 15153v1 Announce Type: new Abstract: Selective prediction with distribution-free risk control promises that, with confidence 1-delta over the calibration draw, the error rate of accepted inputs stays below a user budget alpha.

By Jingwen Zhou, Mingzhe Wang

safety

arXiv Machine Learning

Jun 16

Auditing Machine Unlearning: A Systematic Research on Whether Models Truly Forget

arXiv:2606. 16110v1 Announce Type: new Abstract: Machine unlearning has been extensively studied in response to growing privacy concerns and regulatory requirements.

By Dayong Ye, Tianqing Zhu, Ruiding Huang, Xinbo Fu, Jiayang Li, Bo Liu, Huan Huo, Wanlei Zhou

llms fine-tuning safety

arXiv Machine Learning

Aug 4

Crushing the Evidence: A Dual-Penalty Evasion Framework for Fooling White-Box Explainable AI Auditors

arXiv:2608. 00566v1 Announce Type: new Abstract: Post-hoc model explainers such as LIME, SHAP, and Integrated Gradients are widely deployed to audit models in high-stakes sensitive domains, including finance, healthcare, and social welfare.

By Niraj Kumar, Harsh Kasyap

rag benchmarks safety

Related stories

Temporal Leakage in LLM Backtesting: Measurement, Validation, and Adjusted Scores

The Reliability Gap in Benchmark Auditing: Distribution Shift and Scale as Failure Modes of Contamination Detection

Evaluation Blindness: How Silent Measurement Failures Corrupt AI Systems from Training to Deployment

False Sense of Safety in Selective Signal Classification: Auditing Bound Tightness and Exchangeability for Risk Control

Auditing Machine Unlearning: A Systematic Research on Whether Models Truly Forget

Crushing the Evidence: A Dual-Penalty Evasion Framework for Fooling White-Box Explainable AI Auditors