arXiv Machine Learning

A Specialized Large Multimodal Model for Interpreting PET/CT in Head and Neck Cancer

A specialized large multimodal model, LLaVA‑NeXT, was fine‑tuned on a curated two‑level curriculum of PET/CT image‑conversation pairs to interpret head and neck cancer scans. In external validation across four institutions, the model achieved high ROUGE and similarity scores and outperformed generalist models such as ChatGPT, with primary tumor classification accuracy of 83.14% internally and 69.03% externally. The study demonstrates that domain‑specific LMMs can provide fast, accurate diagnostic support for PET/CT imaging.

arXiv AI
Aug 19

Comprehensive framework for evaluation of deep neural networks in detection and quantification of lymphoma from PET/CT images: clinical insights, pitfalls, and observer agreement analyses

This study presents a clinically relevant framework for evaluating deep neural networks that segment lymphoma lesions in PET/CT images, addressing gaps such as out‑of‑distribution testing and comparison with expert annotators. Using 611 multi‑institutional cases, the authors assess four networks (ResUNet, SegResNet, DynUNet, SwinUNETR) with lesion‑specific metrics, detection criteria, and metabolic‑characteristic‑based thresholds, finding that models perform best on large, intense lesions. The work also demonstrates that network errors mirror those of physicians, highlighting shared challenges with small, faint lesions.

By Shadab Ahamed, Yixi Xu, Sara Kurkowska, Claire Gowdy, Joo H. O, Ingrid Bloise, Don Wilson, Patrick Martineau, Fran\c{c}ois B\'enard, Fereshteh Yousefirizi, Rahul Dodhia, Juan M. Lavista, William B. Weeks, Carlos F. Uribe, Arman Rahmim
arXiv Computer Vision
Aug 21

MUST-PET: MUltimodal Self-supervised learning across Tracers for whole-body PET/CT-based lesion segmentation

arXiv:2608. 19666v1 Announce Type: new Abstract: Deep learning-based whole-body PET-CT lesion segmentation can support cancer staging, treatment planning, and response assessment, but generalization is limited by scarce annotations and domain shifts.

By Bashirul Azam Biswas, Amartya Bhattacharya, Biratal Raj Wagle, Matthew E. Maeder, James B. Yu, Indrani Bhattacharya
Hugging Face Trending Papers
Jul 28

Comparing the Performance of Foundation Model Derived Embeddings with Traditional Approaches for Distant Metastasis Prediction in Head and Neck Cancer

Background: Early prediction of distant metastasis (DM) risk in head and neck cancer (HNC) can enable timely interventions that may improve treatment outcomes. Many current machine learning methods rely on prior knowledge of the region of interest such as tumor segmentations, which require expert knowledge, is time-consuming and introduces user-dependent variability.

arXiv Machine Learning
Aug 19

MagViT: Interpretable Multi-Magnification Transformers with Patient-Level Model Selection for Breast Histopathology

MagViT is an interpretable multi‑magnification transformer that classifies breast histopathology images by extracting representations from four BreakHis magnifications (40X, 100X, 200X, 400X) and fusing them with a learnable, scale‑gated mechanism that can mask missing scales. The model selects the most accurate architectural branch at the patient level using five‑fold cross‑validation, achieving high performance on BreakHis (mean image accuracy 0.9191, patient accuracy 0.9643, macro‑F1 0.9042) and demonstrating preliminary cross‑dataset generalization on BUSI and IDC. Grad‑CAM visualizations confirm that the network focuses on diagnostically relevant regions across magnifications.

By Nabil Ashab, Soumit Kumar Kundu, Saif Mahmud Parvez, Shahadat Hossain Sohag, Bidhan Biswas, Nazmus Subha
arXiv AI
Jun 8

Mitosis Detection in the Wild: Multi-Tumor and Context-Aware Generalization in the MIDOG 2025 Challenge

arXiv:2606. 07368v1 Announce Type: cross Abstract: Automated mitosis detection is a well-established task in computational pathology.

By Marc Aubreville, Jonas Ammeling, Sweta Banerjee, Viktoria Weiss, Taryn A. Donovan, Robert Klopfleisch, Jiaqi Lv, Shan E Ahmed Raza, Rapha\"el Bourgade, Thomas Walter, Yasemin Topuz, Song\"ul Varl{\i}, Charles-Antoine Collins-Fekete, Zhuoyan Shen, Navya Sri Kelam, Nitin Singhal, Christian Marzahl, Brian Napora, Tengyou Xu, Hongyan Gu, Mario Vento, Gennaro Percannella, Norbert Ropiak, Izabela Wasiak, Jie Xiao, Shaojun Liu, Seungho Choe, April Khademi, Vidushi Walia, Sujatha Kotte, Andrew Broad, Alex Wright, Guillaume Balezo, Esha Sadia Nasir, Mostafa Jahanifar, Yosuke Yamagishi, Shouhei Hanaoka, Mattia Sarno, Francesco Tortorella, Biwen Meng, Jingxin Liu, Sara Krauss, Daniel Hieber, Lavish Ramchandani, Dev Kumar Das, Mieko Ochi, Yuan Bae, Piotr Giedziun, Mateusz Maniewski, Vangala Govindakrishnan Saipradeep, Naveen Sivadasan, Leire Benito-Del-Valle, Adrian Galdran, Kaustubh Atey, Sameer Anand Jha, Adinath Dukre, Imran Razzak, Maxime W. Lafarge, Viktor H. Koelzer, Nils Porsche, Nikolas Stathonikos, Mitko Veta, Dominik Hirling, Zsanett Zs\'ofia Iv\'an, Peter Horvath, Katharina Breininger, Christof A. Bertram
arXiv AI
Aug 24

An integrated diffusion-weighted imaging processing and interpretation platform for MR-guided radiotherapy

An integrated, web‑based platform has been developed to process diffusion‑weighted imaging (DWI) from MR‑guided linear accelerators and provide structured, literature‑grounded clinical interpretations. The system combines a deep‑learning pipeline for distortion correction, denoising, and IVIM/ADC fitting with a retrieval‑augmented generation (RAG) agent that references a curated knowledge base and traces each statement to its source. Independent expert ratings of nine glioblastoma cases showed high scores for clinical reasoning, citation quality, and overall utility, with a mean rating of 4.65 out of 5.

By Yunxiang Li, Yan Dai, Yen-Peng Liao, Jie Deng, Jill B De Vis, You Zhang