arXiv Computer Vision
Whole-Body MRI Classification via Prompt-Based Clinical Conditioning
Read the original on arXiv Computer Vision →The Flow has not summarised this story yet — read it at arXiv Computer Vision.
Related stories
arXiv Computer Vision
Aug 21
Exploiting Completeness Perception with Diffusion Transformer for Unified 3D MRI Synthesis
arXiv:2602. 18400v3 Announce Type: replace-cross Abstract: Missing data problems, such as missing modalities in multi-modal brain MRI and missing slices in cardiac MRI, pose significant challenges in clinical practice.
arXiv Computer Vision
Sep 7
Real-World Multi-Modal and Longitudinal Lung Cancer Dataset
The paper presents a newly curated, multi-center, multi-modal, and longitudinal lung cancer dataset comprising 1,365 patients with whole-slide images, CT scans, PET scans, structured clinical data, transcriptomics, and follow-up information. The dataset features substantial, non-uniform missingness across modalities, making it ideal for evaluating robust multi-modal fusion strategies. Benchmarks on 12‑month overall survival, disease‑specific survival, and longitudinal hazard prediction demonstrate that integrating complementary modalities consistently outperforms uni-modal approaches, even under severe missing data.
arXiv AI
Jul 9
ProMoE-FL: Prototype-conditioned Mixture of Experts for Multimodal Federated Learning with Missing Modalities
arXiv:2607. 06633v1 Announce Type: cross Abstract: In this paper, we address the problem of multimodal federated learning with missing modality.
arXiv AI
Jun 16
Unified Multimodal Model for Brain MRI Imputation and Understanding
arXiv:2606. 16484v1 Announce Type: cross Abstract: Multimodal large language models (MLLMs) hold great potential for medicine, as they inherit knowledge from LLM and allow multiple data modalities to be integrated, analysed and interpreted in natural language.
arXiv Computer Vision
Oct 9
Revisiting Integration of Image and Metadata for DICOM Series Classification: Cross-Attention and Dictionary Learning
The paper presents an end‑to‑end multimodal framework for classifying DICOM image series that jointly processes image content and acquisition metadata. It uses modality‑aware encoders, a bi‑directional cross‑modal attention mechanism, and a sparse, missingness‑aware dictionary‑based encoder for metadata, avoiding imputation. The method handles variable series length with a 2.5D visual encoder and demonstrates superior performance on the Duke Liver MRI dataset and a large multi‑institutional cohort, outperforming image‑only, metadata‑only, and other multimodal baselines.
Hugging Face Trending Papers
Jul 21
Advancing Multimodal Fusion on Heterogeneous Medical Data with Hybrid Geometry Attention
Multimodal fusion learning (MFL) has shown great potential in the medical domain, where we are faced with disparate data modalities such as imaging, clinical records, and omics. However, existing MFL strategies face several major challenges.