FedCoRe is a federated learning framework that addresses missing modalities in healthcare by learning representation- or logit-space corrections instead of generating synthetic data. In a MIMIC-derived respiratory deterioration task, the method uses paired examples where a modality is present or absent to train a completion module, achieving partial recovery of performance lost when modalities like ECG or CXR are hidden. The approach emphasizes validation-gated deployment, ensuring that completion is only applied when paired examples and validation evidence support the presence of the missing modality.
By Holger R. Roth, Ziyue Xu, Peter Cnudde
arXiv:2608. 09240v1 Announce Type: cross Abstract: Multimodal federated learning (FL) supports collaborative modeling in privacy-sensitive health-sensing and medical settings, but realistic deployments often exhibit dual-axis modality missingness: clients have different modality sets, and individual samples may contain only subsets of the modalities available locally.
By Adiba Orzikulova, Jaehyun Kwak, Jaemin Shin, Yunqi Guo, Xiaomin Ouyang, Guoliang Xing, Steven Euijong Whang, Sung-Ju Lee
arXiv:2607. 06633v1 Announce Type: cross Abstract: In this paper, we address the problem of multimodal federated learning with missing modality.
By Aavash Chhetri, Bibek Niroula, Eduard Vazquez, Yash Raj Shrestha, Prashnna Gyawali, Loris Bazzani, Binod Bhattarai
arXiv:2608.21941v1 Announce Type: new
Abstract: Accurate assessment of patients in intensive care units (ICUs) is essential for timely clinical intervention and improved patient outcomes. Multimodal...
By Yixin Yang, Yueyang Sun, Weichen Liu, Xianbing Zhao, Sicen Liu
arXiv:2607. 09982v1 Announce Type: new Abstract: Electronic health record (EHR) data are inherently multimodal, and leveraging multiple modalities can improve predictive performance.
By Nikkie Hooman, Zhongjie Wu, Eric C. Larson, Mehak Gupta
arXiv:2608. 13911v1 Announce Type: new Abstract: Federated multimodal medical AI faces modality heterogeneity at both the client and sample levels: clients may systematically lack access to specific modality types, while individual records within the same client may contain different partial modality subsets.
By Adiba Orzikulova, Dong Min Kim, Jaehong Yoon, Sung-Ju Lee