Multimodal Embedding & Reranker Models with Sentence Transformers
Related stories
Training and Finetuning Reranker Models with Sentence Transformers
Multi-Vector (Late Interaction) Embedding Models with Sentence Transformers
Training and Finetuning Multi-Vector Embedding Models with Sentence Transformers
Training and Finetuning Embedding Models with Sentence Transformers
Training and Finetuning Sparse Embedding Models with Sentence Transformers
Train 400x faster Static Embedding Models with Sentence Transformers
Can Frontier LLMs Match Natively Multimodal Embeddings? A Comparison on Hard-Negative Text-to-Image Retrieval
arXiv:2608. 11343v1 Announce Type: new Abstract: Multimodal retrieval and classification across different types of media, spanning text, images,video and audio, has traditionally relied on dual-encoder models that align visual and textual representations through contrastive learning.
Train and Fine-Tune Sentence Transformers Models
WeMM-Embedding: WeChat Multi-Modal Embedding Technical Report
Universal multimodal embeddings are becoming a core component of modern AI systems, enabling heterogeneous content to be represented in a shared space for applications such as retrieval, recommendatio...
FuseLIP: Multimodal Embeddings via Early Fusion of Discrete Tokens
arXiv:2506. 03096v2 Announce Type: replace-cross Abstract: Contrastive language-image pre-training aligns features of text-image pairs in a common latent space via distinct encoders for each modality.
Training-Free Pseudo-Fusion for Composed Image Retrieval with Diffusion Models and Multimodal Large Language Models
arXiv:2608.23102v1 Announce Type: new Abstract: Composed Image Retrieval (CIR) is an emerging paradigm in content-based image retrieval that enables users to formulate compositional queries by combin...