The study investigates when adding zero‑shot pseudo‑labels from vision‑language models (VLMs) to small expert‑labelled medical imaging datasets ceases to improve, and may even degrade, classifier performance. Across three benchmarks—PatchCamelyon, ISIC 2019, and NIH ChestX‑ray14—the crossover point occurs after roughly 20–50, 100, and 250–500 expert labels, respectively, with additional pseudo‑labels reducing macro‑AUC by up to 0.14 points. The analysis shows that the VLM’s labeling quality, rather than the student model size, limits performance, and a simple bias‑variance rule can predict the benefit of pseudo‑labels in most settings.
By Bruce Changlong Xu, Jose K. James, Alexander J. Ryu
The study evaluates 15 frozen hematology foundation-model embeddings across four single‑cell acquisition domains, finding that while in‑domain accuracy is near‑saturated (macro‑F1 0.98–0.997), cross‑dataset performance drops dramatically (34–72%) and model rankings shift. Probe‑dependent rank transfer is observed, with 1‑NN retrieval more stable than linear heads, yet neither reliably predicts target robustness. Calibration deteriorates off‑domain (ECE rises from 0.004 to 0.35), and exposure to internal cohorts confounds shift analysis; a training‑free pseudo‑label‑balanced feature normalization (CBR) modestly improves target‑prior robustness and calibration.
whyItMatters":"The findings highlight that frozen hematology foundation models, though accurate in‑domain, may fail under realistic scanner, site, and class‑prior shifts, underscoring the need for comprehensive audits of accuracy, calibration, exposure, and robustness before clinical deployment."
By Jai Kumar Sharma, Peeyush Tapadiya
Frozen hematology foundation-model (FM) embeddings reach near-saturated in-domain white-blood-cell (WBC) accuracy, but clinical deployment demands reliability across scanners, sites, stains and prepar...
The paper introduces a label‑free method called AURCC for selecting the best foundational model for medical image classification when the target domain lacks labels. AURCC uses a pseudo‑label discrepancy computed by the SUDO framework to score models without fine‑tuning. Experiments on chest X‑ray data across three inter‑hospital shifts show that AURCC closely matches the true model ranking, outperforming simple source‑accuracy baselines especially when source data are limited.
By Juan I\~naki Larrea, Lucas Mansilla, Enzo Ferrante
arXiv:2607. 06605v1 Announce Type: new Abstract: Conformal prediction is being adopted in drug discovery to put an honest number on model reliability: pick an error rate alpha, and the method returns prediction sets containing the true label with probability at least 1 - alpha.
By Muhammadjon Tursunbadalov (School of Science and Technology, Champions College Prep, United States), Mustafojon Tursunbadalov (School of Science and Technology, Champions College Prep, United States)
The paper evaluates three architectures for multi-label retinal disease classification on a unified 39‑target dataset. A staged gated cascade, a flat sigmoid model, and a label‑correlation transformer are compared, all sharing the same backbone and training protocol. The label‑correlation model yields the largest performance gain, and blending it with the flat model under test‑time augmentation achieves the best results across most metrics.
By Md Asif Uddin, Jannatul Ferdous, Asif Islam, Zobaer Mahmud Zisan, Promit Ghosh, Shah Ahafik Arman, Niloy Farhan, Rafeed Rahman
The paper presents Baszta, a Polish multi‑label content‑safety classifier trained by fine‑tuning the 124M‑parameter allegro/herbert‑base‑cased model on five categories (hate, vulgarity, sexual content, crime, self‑harm) using a Focal + R‑Drop objective. In out‑of‑distribution evaluation on the Gadzi Język benchmark, Baszta achieves a small but statistically significant improvement in micro‑F1 over the Bielik Guard system, though the macro‑F1 advantage disappears when both models are properly tuned. The study also explores calibration techniques, showing that per‑category temperature scaling can recover performance lost by Platt scaling or isotonic regression, and discusses the trade‑offs between robust calibration and adversarial recall.
By Adam G\'orski, Mateusz J\k{a}kalak, Rafa{\l} Jakubowski
arXiv:2608.22059v1 Announce Type: cross
Abstract: Pretrained image encoders are central to medical image classification, where expert annotation is costly and task-specific cohorts are often limited....
By Xingtao Lin, Hangqi Ren, Caiwan Sun, You Chen
arXiv:2608.28592v1 Announce Type: new
Abstract: Large language models (LLMs) achieve high scores on medical knowledge examinations, yet real-world oncology is not a knowledge test--it is a sequence o...
By Zhang Sheng, Jinming Li, Wangyang Chen, Zhiwei Bao, Yu YoSean Wang
arXiv:2607. 13423v1 Announce Type: new Abstract: Temperature scaling is the dominant post-hoc calibration method in modern deep learning.
By Wisdom Dogah
The paper introduces FateMultiplicity, a label‑free framework that builds a Rashomon set of statistically admissible models for single‑cell trajectory inference by cross‑fitting held‑out genes and non‑inferiority testing. It shows that model multiplicity is large and depends more on the diversity of the model space than its size, and that per‑cell certified fate margins do not improve assignment reliability compared to baseline models. The study also identifies two robust constructions— a margin‑erosion ratio for branch‑point detection and a certification filter that reduces disagreement with clonal outcomes— that merit further investigation.
By Arjun Bhupatiraju, Abhiram Bhupatiraju
arXiv:2606. 20115v3 Announce Type: replace Abstract: Conformal risk control (CRC) provides distribution-free segmentation guarantees by calibrating a prediction-set threshold on held-out data.
By Nafis Fuad Shahid