arXiv Machine Learning June 16, 2026 By Kyeongmin Yeo, Yunhong Min, Minhyuk Sung

MUNI: Multimodal Unified Latent Diffusion for Coherent Any-to-Any Generation

Read the original on arXiv Machine Learning →

arXiv:2606. 16408v1 Announce Type: new Abstract: We introduce MUNI, an end-to-end multimodal latent diffusion framework for any-to-any generation that unifies subset-conditioned cross-modal generation and unconditional joint sampling through a shared stochastic latent.

Summary generated by The Flow from the publisher's feed. The full article lives at arXiv Machine Learning.

arXiv AI

Jun 12

Hellinger Multimodal Variational Autoencoders

arXiv:2601. 06572v4 Announce Type: replace-cross Abstract: Multimodal variational autoencoders (VAEs) are widely used for weakly supervised generative learning with multiple modalities.

By Huyen Vo, Isabel Valera

multimodal benchmarks

arXiv AI

Aug 11

Compositional Cross-Modality Translation via Whole-Volume Multitask Latent Flow Matching

arXiv:2608. 08135v1 Announce Type: cross Abstract: Cross-modality medical image translation can reduce the burden of multi-modal acquisitions, yet the field remains constrained by two coupled limitations: methods operate on 2D slices or 3D patches rather than whole volumes, and train a separate model for each translation task.

By Daniele Molino, Alessio Zoboli, Camillo Maria Caruso, Valerio Guarrasi, Paolo Soda

diffusion multimodal

arXiv Machine Learning

Aug 6

Multimodal Alignment Through Joint Kernel Entropic Gromov--Wasserstein Optimal Transport

arXiv:2608. 04234v1 Announce Type: cross Abstract: We study the problem of aligning data from multiple modalities into a shared representation space, focusing on settings where strong pretrained unimodal encoders are available but cross-modal paired data are scarce.

By Yixuan Florence Wu, Yilun Zhu, Naichen Shi

rag diffusion multimodal safety

arXiv Machine Learning

22h ago

Expressivity In Multimodal Contrastive Learning

arXiv:2608. 17203v1 Announce Type: cross Abstract: Contrastive learning has become a cornerstone of modern representation learning, powering CLIP-style models that underpin text-to-image generation, vision-language models, and retrieval across a rapidly growing range of modalities.

By Andrew Stuart, Florian Wolf

llms rag diffusion multimodal

arXiv Machine Learning

Jul 13

Mixture of Probes: Learning from Privileged Modalities in Multimodal LLMs Through Probing

arXiv:2607. 08839v1 Announce Type: cross Abstract: Multimodal Large Language Models (MLLMs) are typically designed under the assumption that all modalities available during training will also be accessible at inference.

By Dominick Reilly, Qiyu Wu, Hiromi Wakaki, Srijan Das, Yuki Mistufuji

llms multimodal safety

arXiv Machine Learning

Aug 5

DAIF: A Data-Driven Intermediate Fusion Framework for Multimodal Supervised Learning via Approximate Message Passing

arXiv:2608. 02769v1 Announce Type: cross Abstract: Multimodal supervised learning seeks to leverage multiple heterogeneous data sources to improve predictive performance.

By Sagnik Nandy, Samriddha Lahiry, Pragya Sur, Subhabrata Sen

rag multimodal benchmarks

Related stories

Hellinger Multimodal Variational Autoencoders

Compositional Cross-Modality Translation via Whole-Volume Multitask Latent Flow Matching

Multimodal Alignment Through Joint Kernel Entropic Gromov--Wasserstein Optimal Transport

Expressivity In Multimodal Contrastive Learning

Mixture of Probes: Learning from Privileged Modalities in Multimodal LLMs Through Probing

DAIF: A Data-Driven Intermediate Fusion Framework for Multimodal Supervised Learning via Approximate Message Passing