arXiv:2607. 28608v1 Announce Type: new Abstract: Clinical risk models routinely achieve strong aggregate performance while producing materially different error rates across patient subgroups.
By Sparsh Roy, Samuel Girmachew, Nishita Chavan
arXiv:2607. 18828v1 Announce Type: new Abstract: Readiness stress-testing of medical AI has focused on closed-ended and multimodal benchmarks.
By Koyar Afrasyab
arXiv:2608.21262v1 Announce Type: cross
Abstract: Many machine-learning systems set a threshold at a quantile of a calibration set: conformal predictors that promise 90% coverage by drawing their cut...
By Adam Noonan
DeepGOF-1 is a neural goodness‑of‑fit test for logistic regression that maps residuals over covariate ranks, scores them with a frozen convolutional network, and calibrates the score via parametric bootstrap. It achieves first‑order valid level, offers explicit local power, and outperforms traditional chi‑square and projection tests in simulations and real data, revealing missed interactions and guiding model repairs. In the SUPPORT study, it identified a U‑shaped risk pattern for blood pressure and respiratory rate that standard calibration curves obscured, and it ran in 13 seconds versus hours for competing methods.
By Ebrahim Khaled Ebrahim, Osama Abd El-Aziz Hussein, Ahmed El-Kotory
The paper presents a closed‑form estimator for the contamination correlation between anchors and judges under a single‑common‑factor model, requiring at least two judges and two anchors. It introduces a diagnostic battery—including judge‑covariance dispersion, over‑identification tests, a family‑block test, bootstrap confidence intervals, and a weak‑identification screen—to validate the estimator and detect violations. The authors also discuss identification limits for ordinal data and report that real panels have not yet passed the model‑adequacy pre‑test, while simulation studies confirm the estimator’s performance.
By Veerendra Kumar Sunkavalli
arXiv:2604. 17359v2 Announce Type: replace-cross Abstract: Language models asked to simulate psychiatric patients produce cases that survive inspection one at a time and populations that match no real one.
By Patrick Keough