arXiv Machine Learning June 16, 2026 By Hassan Ismkhan, Hamid Bouchahcia

Unsupervised Learning for Missing Modalities in Multimodal Learning

Read the original on arXiv Machine Learning →

arXiv:2606. 15743v1 Announce Type: new Abstract: This paper addresses the missing-modality challenge in multi-modal learning by introducing Unsupervised Learning for Missing Modalities in Multi-Modal Learning (UL4M4), a flexible framework that imputes missing feature embeddings in a task-independent manner before supervised prediction.

Summary generated by The Flow from the publisher's feed. The full article lives at arXiv Machine Learning.

arXiv AI

Jun 11

Latent World Recovery for Multimodal Learning with Missing Modalities

arXiv:2606. 12362v1 Announce Type: cross Abstract: We study multimodal learning under missing modalities, with particular motivation from bioscience applications in which heterogeneous modalities are often only partially available when decisions need to be made.

By Hui Wang, Tianyu Ren, Joseph Butler, Christopher Baker, Karen Rafferty, Simon McDade

rag diffusion multimodal benchmarks safety

arXiv AI

Jul 28

Co-Learning for Missing Arbitrary Modalities in Multi-modal Classification

arXiv:2607. 24683v1 Announce Type: cross Abstract: Multi-modal classification leverages complementary information across diverse data sources to enhance predictive performance.

By Francisco Mena, Dino Ienco, Roberto Interdonato, Cassio F. Dantas, Simon Besnard

multimodal benchmarks safety

arXiv Machine Learning

Jul 28

FedTaste: Topology-Aware Structural Transfer for Multimodal Federated Learning with Missing Modalities

arXiv:2607. 23245v1 Announce Type: cross Abstract: Multimodal Federated Learning is often challenged by arbitrary modality missingness and Non-IID data distributions, which lead to severe representation drift and hinder effective collaboration across clients.

By Haochen Liang, Jie Zhang, Hideya Ochiai

multimodal safety

arXiv AI

Jun 30

Residual-Guided Expert Specialization for Incomplete Multimodal Learning

arXiv:2606. 30355v1 Announce Type: cross Abstract: As real-world prediction systems often face missing modalities at inference, incomplete multimodal learning (IML) remains a practical challenge.

By Seunghun Baek, Jihwan Park, Jaeyoon Sim, Minjae Jeong, Hoseok Lee, Won Hwa Kim

computer-vision multimodal

Hugging Face Trending Papers

Jun 29

Residual-Guided Expert Specialization for Incomplete Multimodal Learning

As real-world prediction systems often face missing modalities at inference, incomplete multimodal learning (IML) remains a practical challenge. While prior methods aim to learn representations robust to missing inputs, representations from incomplete modalities inevitably deviate from their full-modality counterparts due to missing evidence.

computer-vision multimodal

arXiv AI

Jun 16

Unified Multimodal Model for Brain MRI Imputation and Understanding

arXiv:2606. 16484v1 Announce Type: cross Abstract: Multimodal large language models (MLLMs) hold great potential for medicine, as they inherit knowledge from LLM and allow multiple data modalities to be integrated, analysed and interpreted in natural language.

By Zhiyun Song, Che Liu, Tian Xia, Avinash Kori, Wenjia Bai

llms rag multimodal safety

Related stories

Latent World Recovery for Multimodal Learning with Missing Modalities

Co-Learning for Missing Arbitrary Modalities in Multi-modal Classification

FedTaste: Topology-Aware Structural Transfer for Multimodal Federated Learning with Missing Modalities

Residual-Guided Expert Specialization for Incomplete Multimodal Learning

Residual-Guided Expert Specialization for Incomplete Multimodal Learning

Unified Multimodal Model for Brain MRI Imputation and Understanding