arXiv Machine Learning August 19, 2026 By Andrew Stuart, Florian Wolf

Expressivity In Multimodal Contrastive Learning

Read the original on arXiv Machine Learning →

arXiv:2608. 17203v1 Announce Type: cross Abstract: Contrastive learning has become a cornerstone of modern representation learning, powering CLIP-style models that underpin text-to-image generation, vision-language models, and retrieval across a rapidly growing range of modalities.

Summary generated by The Flow from the publisher's feed. The full article lives at arXiv Machine Learning.

arXiv AI

Jun 12

Hellinger Multimodal Variational Autoencoders

arXiv:2601. 06572v4 Announce Type: replace-cross Abstract: Multimodal variational autoencoders (VAEs) are widely used for weakly supervised generative learning with multiple modalities.

By Huyen Vo, Isabel Valera

multimodal benchmarks

arXiv Machine Learning

Jul 16

The Hyperspherical Geometry of CLIP Latent Space: A Semantic Mixture Model

arXiv:2607. 13660v1 Announce Type: new Abstract: Contrastive Language-Image Pretraining (CLIP) representations form a semantic embedding space governed by cosine similarity, reflecting an intrinsic hyperspherical geometry.

By Zijie Yu, Gaowen Liu, Ramana Rao Kompella, Philip S. Yu, Yue Song

rag diffusion multimodal

arXiv AI

Jun 12

Cross-Modal Masked Compositional Concept Modeling for Enhancing Visio-Linguistic Compositionality

arXiv:2606. 13288v1 Announce Type: cross Abstract: Contrastively trained vision-language models like CLIP, have made remarkable progress in learning joint image-text representations, but still face challenges in compositional understanding.

By Wei Li, Zhen Huang, Xinmei Tian

llms diffusion multimodal benchmarks

arXiv Machine Learning

Jun 16

MUNI: Multimodal Unified Latent Diffusion for Coherent Any-to-Any Generation

arXiv:2606. 16408v1 Announce Type: new Abstract: We introduce MUNI, an end-to-end multimodal latent diffusion framework for any-to-any generation that unifies subset-conditioned cross-modal generation and unconditional joint sampling through a shared stochastic latent.

By Kyeongmin Yeo, Yunhong Min, Minhyuk Sung

llms rag diffusion multimodal benchmarks

arXiv AI

Jun 8

Modality Gap-Driven Subspace Alignment Training Paradigm For Multimodal Large Language Models

arXiv:2602. 07026v3 Announce Type: replace-cross Abstract: Despite the success of multimodal contrastive learning in aligning visual and linguistic representations, a persistent geometric anomaly, the Modality Gap, remains: embeddings of distinct modalities expressing identical semantics occupy systematically offset regions.

By Xiaomin Yu, Yi Xin, Yuhui Zhang, Wenjie Zhang, Chonghan Liu, Hanzhen Zhao, Chen Liu, Xiaoxing Hu, Ziyue Qiao, Hao Tang, Xiaobin Hu, Chengwei Qin, Hui Xiong, Yu Qiao, Shuicheng Yan

llms rag fine-tuning multimodal safety

arXiv AI

Jun 30

Multimodal Representation Alignment for Cross-modal Information Retrieval

arXiv:2506. 08774v2 Announce Type: replace-cross Abstract: Different machine learning models can represent the same underlying concept in different ways.

By Fan Xu, Luis A. Leiva

llms rag multimodal benchmarks safety

Related stories

Hellinger Multimodal Variational Autoencoders

The Hyperspherical Geometry of CLIP Latent Space: A Semantic Mixture Model

Cross-Modal Masked Compositional Concept Modeling for Enhancing Visio-Linguistic Compositionality

MUNI: Multimodal Unified Latent Diffusion for Coherent Any-to-Any Generation

Modality Gap-Driven Subspace Alignment Training Paradigm For Multimodal Large Language Models

Multimodal Representation Alignment for Cross-modal Information Retrieval