arXiv Machine Learning June 5, 2026 By Shuxuan Li, Zhilin Zhao, Quyu Kong, Wei-Shi Zheng

Bridging Domain Expertise and Generalization for Performance Estimation

Read the original on arXiv Machine Learning →

arXiv:2606. 06335v1 Announce Type: new Abstract: Performance estimation under distribution shift aims to predict how a model behaves on an unlabeled test set whose distribution differs from the training data, a scenario that requires reliable indicators that can faithfully reflect model behavior without ground-truth labels.

Summary generated by The Flow from the publisher's feed. The full article lives at arXiv Machine Learning.

safety

arXiv AI

Jun 2

Domain-Shift-Aware Conformal Prediction for Large Language Models

arXiv:2510. 05566v2 Announce Type: replace-cross Abstract: Large language models have achieved impressive performance across diverse tasks.

By Zhexiao Lin, Yuanyuan Li, Neeraj Sarna, Yuanyuan Gao, Michael von Gablenz

llms benchmarks safety

arXiv Machine Learning

Jul 24

DataPrep-Bench: Benchmarking LLMs as Training Data Preparators

arXiv:2607. 20465v1 Announce Type: new Abstract: The quality of training data fundamentally determines the capabilities of large language models (LLMs), yet no unified benchmark exists to measure how well LLMs, agents, and data-centric workflows actually prepare training data end to end.

By Hao Liang, Qifeng Cai, Yibo Lin, Jianzhuo Du, Qifeng Xia, Sizhe Qiu, Linzhuang Sun, Meiyi Qiang, Zhaoyang Han, Xiaochen Ma, Bohan Zeng, Ruichuan An, Conghui He, Wentao Zhang

llms agents fine-tuning benchmarks safety data-engineering

arXiv Machine Learning

Aug 4

Learning the Pareto Frontier of Predictive Models under Distribution Shift

arXiv:2608. 00632v1 Announce Type: new Abstract: Modern machine learning pipelines increasingly rely on reusing pretrained and foundation models across downstream tasks.

By Yiming Dong, Jiwei Zhao, Yang Young Lu

fine-tuning

arXiv Machine Learning

Jul 10

Prediction-Powered Active Testing

arXiv:2607. 08347v1 Announce Type: cross Abstract: Active testing provides a label--efficient approach to risk estimation by adaptively selecting which test points should be labelled.

By Kianoosh Ashouritaklimi, Valentin Kilian, Daolang Huang, Tom Rainforth, Fran\c{c}ois Caron

arXiv AI

Jun 12

Cross-Model Disagreement as a Label-Free Correctness Signal

arXiv:2603. 25450v2 Announce Type: replace Abstract: Detecting when a language model is wrong without ground truth labels is a fundamental challenge for safe deployment.

By Matt Gorbett, Suman Jana

llms benchmarks

arXiv Machine Learning

Jul 21

LFM: Leveraging Foundation Models for Source-Free Universal Domain Adaptation

arXiv:2607. 17653v1 Announce Type: cross Abstract: Source-free universal domain adaptation (SF-UniDA) adapts a pre-trained source model to an unlabeled target domain under both covariate and label shifts, without access to source data.

By Jing Li, Pan Liu, Meng Zhao, Wanli Xue, Yanhong Yang, Xu Cheng, Fan Shi, Jianhua Zhang, Qinghua Hu, Shengyong Chen

llms fine-tuning multimodal benchmarks

Related stories

Domain-Shift-Aware Conformal Prediction for Large Language Models

DataPrep-Bench: Benchmarking LLMs as Training Data Preparators

Learning the Pareto Frontier of Predictive Models under Distribution Shift

Prediction-Powered Active Testing

Cross-Model Disagreement as a Label-Free Correctness Signal

LFM: Leveraging Foundation Models for Source-Free Universal Domain Adaptation