arXiv Computer Vision

Auditable CT Phenotyping Through Report-derived Radiological Observations

The study introduces Auditable CT Phenotyping (ACT), a method that uses report-derived radiological observations to predict 221 electronic-health-record phenotypes from CT scans. Trained on 38,317 patients and evaluated on 25,183 held‑out patients, ACT outperformed five vision‑language baselines and CT‑CLIP in both zero‑shot and linear probing settings. Analysis of the model’s probes revealed that a small set of observations, such as aortic and coronary calcification, dominated top predictions, but restricting the observation bank to clinician‑specified evidence improved interpretability without sacrificing accuracy.

arXiv AI
Jun 2

CardioLens: Revealing the Clinical Reality Gap of MLLMs via Multi-Sequence Cardiac MRI Evaluations

arXiv:2606. 00123v1 Announce Type: cross Abstract: Multimodal Large Language Models (MLLMs) have shown strong performance on public medical benchmarks, yet existing evaluations often remain weak proxies for clinical use, relying on isolated inputs and simplified recognition-style tasks.

By Zixian Su, Hongkai Zhang, Fan Gao, Encheng Su, Taiping Qu, Jingwei Guo, Nan Zhang, Hui Wang, Zhen Zhou, Kairui Bo, Yan Chen, Yue Ren, Shuai Li, Lei Xu, Henggui Zhang
arXiv AI
Jul 14

A Unified Framework for Comprehensive Cardiac CT Segmentation and Phenotyping: Human-in-the-Loop Data Annotation, Vision Foundation Model Development, Multicenter Evaluation and Clinical Validation

arXiv:2607. 11287v1 Announce Type: cross Abstract: Comprehensive quantification of cardiac structures from computed tomography (CT) remains limited not by data availability but by the scalability of measurements, which makes routine use impractical.

By Pooya Mohammadi Kazaj, Leo Fridolin Weber, Wen Xie, Seyed Amir Ahmad Safavi-Naini, Anselm Stark, Giovanni Baj, Ali Mokhtari, Toshiya Yoshida, Christoph Ryffel, Taishi Okuno, Yoshihiro Akashi, Ronny R. Buechel, Thomas Pilgrim, Waldo Valenzuela, George C. M. Siontis, Xiaowei Xu, Moritz Hundertmark, Stephan Windecker, Christoph Grani, Isaac Shiri
arXiv Machine Learning
Jul 2

Foundation Models vs. Radiomics for Lung Computed Tomography: A Benchmark of Feature Extractors, Classification Heads, and Segmentation Choices

arXiv:2607. 01001v1 Announce Type: cross Abstract: Radiomics is the established approach for CT-based lung cancer phenotyping, yet comparisons with foundation models rarely isolate contributions of feature extractor, classification head, and segmentation choice, or test cross-cohort robustness.

By Nils Neukirch, Martin Maurer, Nils Strodthoff