arXiv Computer Vision

Preoperative Prediction of Microvascular Invasion in Hepatocellular Carcinoma by Integrating Multimodal Ultrasound and Clinical Data: A Multicenter Study

The study developed a multimodal ultrasound and clinical data model to predict microvascular invasion (MVI) preoperatively in hepatocellular carcinoma (HCC). Using data from 489 patients across eight centers, the model combined B-mode ultrasound, color Doppler flow imaging, dynamic contrast-enhanced ultrasound, and clinical information, achieving an AUC of 0.8953 in external validation. Dynamic contrast-enhanced ultrasound contributed the most predictive power, while other modalities and clinical data added complementary value.

arXiv Computer Vision
Sep 23

Neoadjuvant chemotherapy response prediction using pretreatment diffusion and contrast-enhanced magnetic resonance imaging with clinical variables

arXiv:2609.26105v1 Announce Type: cross Abstract: Prediction of pathological complete response before neoadjuvant chemotherapy may facilitate more tailored therapeutic planning for breast cancer pati...

By Pablo Garc\'ia Marcos, Paula Puerta Gonz\'alez, Guillermo Lorenzo, H\'ector G\'omez, Covadonga del Camino, Ad\'an Rodr\'iguez, Ignacio Pel\'aez, Angel Rio-Alvarez, V\'ictor M. Gonz\'alez
arXiv AI
Jul 15

Calibrated Selective Prediction Using Deep Ensembles for ROI-Based Thyroid Nodule Ultrasound Classification Under Dataset Shift: A Retrospective Evaluation

arXiv:2607. 12075v1 Announce Type: cross Abstract: Background: Deep learning models can classify thyroid nodules on ultrasound, but reliable clinical decision support also requires calibrated probabilities, uncertainty estimation, and selective referral, particularly under dataset shift.

By Md. Sadibul Hasan Sadib, Md. Mohayminul Mukit, Rahmatul Kabir Rasel Sarker, Tahmid Alam Tamim, Md. Monir Hossain Shimul
arXiv AI
Sep 24

A Leakage-Aware Multimodal Evaluation Framework for Early Intraoperative Acute Kidney Injury Prediction

The study introduces SynerT, a waveform-only hybrid temporal model that uses a causal dilated TCN and dilated recurrent layers to predict early intraoperative acute kidney injury (AKI). Two extensions, SynerT-MM and SynerT-Stack, incorporate hemodynamic summaries, preoperative covariates, and a leakage-safe stacked ensemble to improve discrimination and calibration. Evaluated on the VitalDB database with a strict 60‑minute prediction window, SynerT-Stack achieved the best performance across AUROC, AUPRC, and F1‑max, and demonstrated the greatest net clinical benefit after recalibration.

By Quang Minh Nguyen, Duc Minh Le, Ho Nhat Minh Nguyen, Thuy Quynh Nguyen, Trong Nghia Nguyen
arXiv AI
Sep 24

Cross-Modal Contrastive Learning from Histopathology and CT for Automated Renal Cell Carcinoma Grading

The study introduces RCC-Align, a cross‑modal contrastive learning framework that aligns paired histopathology whole‑slide images and CT scans to enhance noninvasive grading of clear cell renal cell carcinoma (ccRCC). Using patient‑level five‑fold cross‑validation on TCGA and CPTAC cohorts, RCC‑Align achieved an AUC of 0.601 and AUPRC of 0.599 for low‑ versus high‑grade ccRCC classification, outperforming CT‑only baselines and showing stronger WSI‑CT embedding alignment. The approach relies solely on CT at inference, potentially aiding grading when biopsy is unsafe or limited by tumor heterogeneity.

By Amit Das, Tanmay Shukla, Naofumi Tomita, Faraz Farhadi, Jessica Sin, Ari Hakimi, Chad Vanderbilt, Jie-Fu Chen, Ritesh Kotecha, Weijie Ma, Bing Ren, Saeed Hassanpour
arXiv AI
Sep 7

Cross-modal triage network: a multimodal deep learning framework for severity-based triage and visual explainability in chest radiographs

The paper introduces the Cross‑Modal Triage Network (CMTN), a multimodal deep‑learning model that fuses a Swin Transformer V2 visual encoder with a PubMedBERT text encoder to perform severity‑based triage, pathology detection, and generate visual explanations for chest radiographs. Trained on 34,639 image‑text pairs from MIMIC‑CXR‑JPG, the CMTN achieves high ordinal agreement with reference labels (QWK = 0.9341) and excellent pathology detection (macro‑AUROC = 0.9970) while operating with 34 ms latency. However, a blinded clinical audit revealed low agreement with expert radiologists (QWK = 0.1399) and only modest spatial‑semantic concordance in heatmaps, underscoring the gap between algorithmic performance and clinical judgment.

By Zinah Ghulam, Richa Mittal, Eranga Ukwatta
arXiv AI
Sep 1

Extending TotalSegmentator: Predicting Patient and Acquisition Characteristics from CT and MR Images

arXiv:2608.29348v1 Announce Type: new Abstract: Background: Patient details and acquisition metadata are important for clinical decisions, image quality control, and automated research pipelines, but...

By Jakob Wasserthal, Joshy Cyriac, Michael Bach, Kimia Mozahheb Yousefi, Minh-Son To, M\'at\'e Sik, C\'edric H\'emon, Thomas Weikert, Martin Segeroth
arXiv AI
Jun 17

Probing, Fusion, and Trustworthiness: A Systematic Evaluation of Foundation Model Representations for Multimodal Cancer Analysis

arXiv:2606. 17115v1 Announce Type: cross Abstract: Foundation models (FMs) have emerged as powerful representation extractors for medical data, yet their generalizability to datasets under distribution shift remains underexplored.

By Jingyu Hu, Giuseppe Tripodi, Reed Naidoo, Sarah F. McGough, Tapabrata Chakraborti
arXiv Computer Vision
Sep 23

Radiomics--Foundation Fusion for Interpretable RCC Classification: Internal Benchmarking and Exploratory External Transfer

arXiv:2609.26578v1 Announce Type: new Abstract: Accurate preoperative subtype classification of renal cell carcinoma (RCC) from contrast-enhanced CT remains clinically challenging because clear cell...

By Yuan Liang, Fangyijie Wang, Kathleen M. Curran, Gu\'enol\'e Silvestre, Sourav Bhattacharjee, Abraham Campbell
arXiv Computer Vision
Sep 25

A Multimodal Dataset for Survival Prediction in Resected Pancreatic Ductal Adenocarcinoma

The paper introduces a multimodal dataset for survival prediction in resected pancreatic ductal adenocarcinoma, comprising 302 patients, 446 H&E whole-slide images, clinicopathological variables, targeted sequencing data for 154 patients, and overall survival outcomes. The authors evaluated fourteen survival‑prediction models, finding that a Ridge Cox regression on numeric clinicopathological variables achieved the highest concordance (≈0.65), while multimodal fusion of image and molecular data reached 0.619. These benchmarks provide a foundation for future research and external validation using this pancreas‑specific dataset.

By Anh-Tien Nguyen, Mawuko Tettey, Jacqueline Michelle Metsch, Teresa Zimmer, Niklas Ullrich, Mario Duker, Sandra Rungeling, Kirsten Reuter-Jessen, Tessa Rosenthal, Lena-Christin Conradi, Michael Ghadimi, Alexander Konig, Elisabeth Hessmann, Volker Ellenrieder, Philipp Strobel, Hanibal Bohnenberger, Anne-Christin Hauschild