OmniMed‑FL is a multimodal federated learning framework that fuses chest radiographs and synthetic patient notes to classify five clinical conditions. The study benchmarks eight fusion strategies, three initializations, and four missing‑text imputation rules across 3–20 hospital clients under non‑IID Dirichlet partitioning, showing that federated approaches (FedAvg, FedProx, SCAFFOLD‑AdamW) outperform local‑only training. Multimodal fusion consistently improves performance, achieving macro‑F1 scores up to 0.956 on the synthetic corpus and 0.906 on the radiograph corpus.
Simultaneous assessment of medical imaging and patient records is often required in clinical diagnosis. However, standard machine learning algorithms cannot analyze these data types together. Meanwhil...
The paper evaluates federated learning with Low‑Rank Adaptation (LoRA) for fine‑tuning the BiomedCLIP vision‑language model on chest X‑ray classification across four international cohorts. Federated LoRA improves shared‑class AUC from 0.687 to 0.802, outperforming isolated single‑cohort training and approaching a centralized reference. The study shows that SVD‑based product‑space aggregation (FlexLoRA) is crucial for performance, while FedProx offers no advantage over FedAvg in this setting.
arXiv:2509. 10517v3 Announce Type: replace Abstract: Machine learning can predict in-hospital mortality, but data privacy and the statistical heterogeneity of clinical data hamper its use.
arXiv:2607. 20641v1 Announce Type: new Abstract: Federated learning (FL) enables multiple clinical institutions to collaboratively train a shared disease classifier without centralizing patient data.
GAMF-Net is a grouped availability‑aware multimodal fusion network designed for smartphone skin lesion classification. It divides ten clinical variables into three semantic groups—demographics, history‑related risk, and lesion presentation—and encodes each group with field values and availability masks. The image branch supplies base logits while each clinical group contributes image‑conditioned residual evidence; only available groups are fused with equal weight, and the model defaults to image‑only when no clinical data are present. Evaluated on PAD‑UFES‑20, GAMF-Net achieves an accuracy of 74.17 % and outperforms image‑only and other multimodal baselines, with ablation studies highlighting the importance of clinical information and constrained equal‑weight fusion.
FedDRAW introduces a new server‑side aggregation technique for federated learning called Federated Dual Reputation Annealing Weighting. It blends a data‑size prior with cosine similarity between client and global model parameters, using two annealing schedules to shift weight from size to similarity and to gradually relax selectivity. Experiments on 12 simulated client partitions of CheXpert and ChestMNIST datasets show FedDRAW outperforms seven federated baselines in AUC and geometric mean of sensitivity and specificity, with statistically significant results.
Fed-ReMasker is a federated learning approach that adapts the ReMasker masked autoencoder for tabular data imputation, specifically addressing feature-level missingness where entire features are absent at some centers. The method enables centers to impute unobserved features by leveraging knowledge from collaborating institutions. In benchmark tests on synthetic and real-world datasets, Fed-ReMasker achieves the lowest imputation error in the majority of scenarios and remains robust to client heterogeneity, closely matching the performance of a centralized model.
The paper introduces SCCL-DT, a method that improves zero‑shot chest X‑ray diagnosis by addressing semantic conflicts in contrastive vision‑language pre‑training. It uses adaptive thresholds derived from exponential‑moving‑average statistics to hard‑mask conflicting pairs, and combines two teachers—an inclusive and a consensus rule—through distillation into a single student model. On five public chest X‑ray benchmarks, SCCL‑DT achieves a mean zero‑shot AUC of 0.850, outperforming the best baseline at 0.837.
We describe the DS@GT submissions to the ImageCLEFmedical Caption 2026 challenge, which continues a long-running benchmark on the ROCOv2 dataset with two tracks: Concept Detection (Task 1), assigning UMLS Concept Unique Identifiers (CUIs) to radiology images, and Caption Prediction (Task 2), generating natural-language captions. For Task 1, our primary submission was a three-way late-fusion ensemble of ConvNeXt-V2, BiomedCLIP ViT-B/16, and DenseNet-169 with a regularized ''Honest Threshold Tuning'' procedure designed to avoid validation overfitting on rare concepts; this submission ranked first on the official submission with a primary $F_1$ of $0.
arXiv:2607. 08219v2 Announce Type: replace-cross Abstract: The privacy requirements of medical data and its substantial variations across organs and modalities hinder the clinical implementation of medical AI.
The paper introduces the Cross‑Modal Triage Network (CMTN), a multimodal deep‑learning model that fuses a Swin Transformer V2 visual encoder with a PubMedBERT text encoder to perform severity‑based triage, pathology detection, and generate visual explanations for chest radiographs. Trained on 34,639 image‑text pairs from MIMIC‑CXR‑JPG, the CMTN achieves high ordinal agreement with reference labels (QWK = 0.9341) and excellent pathology detection (macro‑AUROC = 0.9970) while operating with 34 ms latency. However, a blinded clinical audit revealed low agreement with expert radiologists (QWK = 0.1399) and only modest spatial‑semantic concordance in heatmaps, underscoring the gap between algorithmic performance and clinical judgment.
The study evaluates how well different medical foundation models agree on image embeddings by measuring mutual k‑nearest‑neighbor overlap across 750,000 images from 14 datasets and 18 public models. Results show that label‑supervised models converge the least, sharing only 6–10% of nearest neighbors, whereas models trained with self‑distillation, masked image modeling, or contrastive pretraining share up to 80%. The authors suggest that developers can select pretraining objectives to control convergence and recommend testing unlabeled images for nearest‑neighbor consistency before replacing a model.