arXiv Machine Learning August 17, 2026 By Adiba Orzikulova, Dong Min Kim, Jaehong Yoon, Sung-Ju Lee

MedMix: Specialization-Consistent Federated Sparse MoEs under Modality Heterogeneity

Read the original on arXiv Machine Learning →

arXiv:2608. 13911v1 Announce Type: new Abstract: Federated multimodal medical AI faces modality heterogeneity at both the client and sample levels: clients may systematically lack access to specific modality types, while individual records within the same client may contain different partial modality subsets.

Summary generated by The Flow from the publisher's feed. The full article lives at arXiv Machine Learning.

arXiv AI

Jun 10

LongMoE: Longitudinal Multimodal Learning via Trajectory-Aware Mixture-of-Experts

arXiv:2606. 09907v1 Announce Type: cross Abstract: Multimodal clinical learning is increasingly important for integrating diverse patient data, including imaging, text, and personalised health records.

By Maxx Richard Rahman, Prakhar Kumar, Wolfgang Maass

nlp multimodal

arXiv Machine Learning

Jul 30

FedWeave: Rethinking the Unit of Specialization in Heterogeneous Federated MoE-LoRA

arXiv:2607. 26618v1 Announce Type: new Abstract: Federated PEFT enables LLMs to collaboratively adapt to decentralized private data without sharing raw examples.

By Donghang Duan, Xu Zheng, Lizong Zhang, Chong Mu, Meng Han

llms fine-tuning benchmarks

arXiv Machine Learning

Jul 20

Toward Federated Multimodal Graph Foundation Models: A Topology-Aware Multimodal Alignment Framework

arXiv:2607. 15687v1 Announce Type: new Abstract: Multimodal-attributed graphs (MAGs), whose nodes carry modalities such as images and text alongside topological structure, now pervade applications including social platforms, e-commerce, and biomedical networks, offering richer semantic signals than single-modality graphs.

By Xunkai Li, Guohao Fu, Yuming Ai, Zhengyu Wu, Hongchao Qin, Rong-Hua Li, Guoren Wang

fine-tuning multimodal safety

arXiv Machine Learning

Jun 9

PRISM: Topology-Aware Cross-Modal Imputation for Modality-Deficient Federated Graph Learning

arXiv:2606. 09301v1 Announce Type: new Abstract: Multimodal federated graph learning (MM-FGL) aims to collaboratively learn from decentralized graphs with text and images.

By Zekai Chen, Miao Zhang, Jiayang Xing, Xunkai Li, Xun Wu, Rong-Hua Li, Guoren Wang

llms multimodal benchmarks

arXiv AI

Jun 30

Residual-Guided Expert Specialization for Incomplete Multimodal Learning

arXiv:2606. 30355v1 Announce Type: cross Abstract: As real-world prediction systems often face missing modalities at inference, incomplete multimodal learning (IML) remains a practical challenge.

By Seunghun Baek, Jihwan Park, Jaeyoon Sim, Minjae Jeong, Hoseok Lee, Won Hwa Kim

computer-vision multimodal

arXiv Machine Learning

Aug 4

Towards Effective Federated Multimodal Graph Learning via Navigating Multifaceted Heterogeneity

arXiv:2608. 00623v1 Announce Type: new Abstract: Multimodal-attributed graphs (MAGs), where nodes carry heterogeneous semantic content across multiple modalities while edges encode relational dependencies, have been widely adopted across diverse domains.

By Yinlin Zhu, Di Wu, Yi Zhang, Xunkai Li, Wang Luo, Wei-Jin Huang, Miao Hu, Guocong Quan

fine-tuning multimodal benchmarks

Related stories

LongMoE: Longitudinal Multimodal Learning via Trajectory-Aware Mixture-of-Experts

FedWeave: Rethinking the Unit of Specialization in Heterogeneous Federated MoE-LoRA

Toward Federated Multimodal Graph Foundation Models: A Topology-Aware Multimodal Alignment Framework

PRISM: Topology-Aware Cross-Modal Imputation for Modality-Deficient Federated Graph Learning

Residual-Guided Expert Specialization for Incomplete Multimodal Learning

Towards Effective Federated Multimodal Graph Learning via Navigating Multifaceted Heterogeneity