arXiv Machine Learning

Foundation model embeddings capture pre-diagnostic changes on screening mammograms

The study examined whether embeddings from four foundation models—Mammo-CLIP, HOPPR, MedImageInsight, and BiomedCLIP—could detect pre‑diagnostic changes in screening mammograms. Using 1,773 biopsied women and matched controls, the researchers measured the speed of movement along a data‑derived “cancer direction” in embedding space over successive screening intervals. They found that embeddings from clinically grounded models (Mammo‑CLIP, HOPPR, MedImageInsight) showed faster drift in malignant cases compared to controls, while the general biomedical model BiomedCLIP did not, indicating that foundation model embeddings can encode early tissue changes without task‑specific fine‑tuning.

arXiv Machine Learning
Aug 26

A Multimodal Foundation Model for Longitudinal Patient Representation and Scalable Insight Generation in Oncology

arXiv:2608.24688v1 Announce Type: new Abstract: Precision oncology necessitates a longitudinal model of patient state that captures cancer evolution and treatment over time, integrating multimodal ob...

By Eugene Vorontsov, Yi Kan Wang, Alican Bozkurt, Adam Casson, Ludmila Tydlitatova, Michal Zelechowski, Ezra E. W. Cohen, Jyoti D. Patel, Max Banaszak, Caitlin McWilliams, Shane Colley, Kate Sasser, Ryan Fukushima, Eric Lefkofsky, Razik Yousfi, Siqi Liu
arXiv Machine Learning
Sep 11

Longitudinal Risk Prediction in Mammography with Privileged History Distillation

The paper introduces SEM‑HD, a framework that leverages longitudinal mammography history as privileged information during training to improve risk prediction while requiring only a single current exam at inference. By having a student model predict latent representations of past visits and using teacher supervision from actual longitudinal data, SEM‑HD preserves temporal modeling benefits without needing prior exams at deployment. Experiments on three cohorts and two backbone architectures show consistent gains in long‑horizon AUC and pAUC, especially in low false‑positive‑rate regions, and recover much of the performance gap to full‑history models.

By Banafsheh Karimian, Soufiane Belharbi, Alexis Guichemerre, Luke McCaffrey, Mohammadhadi Shateri, Eric Granger
arXiv Machine Learning
Sep 18

Mammography Foundation Models for Opportunistic Prediction of Major Adverse Cardiovascular Events

The study evaluates whether mammography foundation models, pretrained for breast cancer tasks, can predict 5‑year major adverse cardiovascular events (MACE) in women using only screening mammograms. In a cohort of 22,497 women (500 MACE events), the models achieved AUROCs of 0.823 and 0.822, outperforming an age‑only baseline. The models also identified higher risk in patients with radiologist‑documented breast arterial calcifications, despite never being trained on that label.

By Paula Feldman, Nusrat Binta Nizam, Sunwoo Kwak, Batuhan Karaman, Katerina Dodelzon, Mert Sabuncu
arXiv AI
Jul 14

Longitudinal Multi-View Breast Cancer Risk Prediction

arXiv:2607. 11343v1 Announce Type: cross Abstract: Accurate breast cancer risk prediction from screening mammography is critical for enabling personalized screening intervals and early detection.

By Solveig Thrun, Zijun Sun, Suaiba A. Salahuddin, Kristoffer Wickstr{\o}m, Elisabeth Wetzer, Stine Hansen, Robert Jenssen, Michael Kampffmeyer
arXiv Computer Vision
Sep 4

Solving the Needle-in-a-Haystack Problem in Mammography Vision-Language Model with Differentiable Subset Sampling

The paper introduces TopKSigLIP, a vision‑language model tailored for mammography that tackles two key challenges: high‑resolution imaging and homogeneous radiology reports. It replaces standard CLIP training with a TopK‑Patch module that selects sparse high‑resolution patches likely to contain lesions, and a Sup‑sigmoid loss that uses soft labels from structured data instead of contrastive loss. TopKSigLIP outperforms existing open‑source mammography and general medical VLMs on zero‑shot tasks such as density assessment, BI‑RADS classification, finding subtyping, and cancer prediction, while also providing better lesion localization than Grad‑CAM.

By Young Seok Jeon, Beatrice Brown-Mulry, Rohan Satya Isaac, Anjana Dissanayaka, Theo Dapamede, Mohammadreza Chavoshi, Judy Gichoya, Hari Trivedi
arXiv Computer Vision
Sep 15

From Density to Biopsy Decisions and Malignancy Prediction: A Benchmark Study of Multimodal Large Language Models Against Radiologists in Digital and Contrast-Enhanced Mammography

arXiv:2609.14676v1 Announce Type: new Abstract: Purpose: To compare four multimodal large language models (MLLMs) with radiologists of varying expertise in breast density assessment, BI-RADS assessme...

By Ali Abbasian Ardakani, Afshin Mohammadi, Taha Yusuf Kuzan, Beyza Nur Kuzan, Alisa Mohebbi, Masume Behruzi, Hamid Khorshidi, Ashkan Ghorbani, Elham Asadiara, Zeinab Khorshidi Lotfi, Ansar Rahman, Nedim Christoph Beste, U. Rajendra Acharya, Sepideh Hatamikia