arXiv Computer Vision
CrossFeat: Bridging Imaging Modalities in Feature Descriptor Space
Read the original on arXiv Computer Vision →The Flow has not summarised this story yet — read it at arXiv Computer Vision.
Related stories
arXiv Machine Learning
Aug 18
FuseLIP: Multimodal Embeddings via Early Fusion of Discrete Tokens
arXiv:2506. 03096v2 Announce Type: replace-cross Abstract: Contrastive language-image pre-training aligns features of text-image pairs in a common latent space via distinct encoders for each modality.
arXiv Machine Learning
Jun 30
Same Concept, Different Directions: Cross-Modal Feature Heterogeneity in Sparse Autoencoders
arXiv:2606. 29888v1 Announce Type: new Abstract: Vision-language models map images and text into a joint embedding space.
Hugging Face Trending Papers
Jun 3
COMBINER: Composed Image Retrieval Guided by Attribute-based Neighbor Relations
Composed Image Retrieval (CIR) represents a challenging retrieval task that targets locating specific images through multimodal inputs. Despite recent progress in CIR techniques, prior approaches often overlook cases where images appear visually alike yet differ in attributes, potentially undermining both multimodal feature fusion and similarity modeling.
Hugging Face Trending Papers
Jul 21
Advancing Multimodal Fusion on Heterogeneous Medical Data with Hybrid Geometry Attention
Multimodal fusion learning (MFL) has shown great potential in the medical domain, where we are faced with disparate data modalities such as imaging, clinical records, and omics. However, existing MFL strategies face several major challenges.
arXiv AI
Jun 9
A Mixed Diet Makes DINO An Omnivorous Vision Encoder
arXiv:2602. 24181v2 Announce Type: replace-cross Abstract: Pre-trained vision encoders like DINOv2 have demonstrated exceptional performance on unimodal tasks.
arXiv AI
Jul 7
SpectralGCD: Spectral Concept Selection and Cross-modal Representation Learning for Generalized Category Discovery
arXiv:2602. 17395v2 Announce Type: replace-cross Abstract: Generalized Category Discovery (GCD) aims to identify novel categories in unlabeled data while leveraging a small labeled subset of known classes.