arXiv AI
Codebook-Guided Cross-Modal Knowledge Distillation for Structurally Heterogeneous Features
Read the original on arXiv AI →The Flow has not summarised this story yet — read it at arXiv AI.
Related stories
arXiv AI
Jun 10
Cross-Modal Knowledge Distillation without Paired Data: Theoretical Foundation and Algorithm
arXiv:2606. 10504v1 Announce Type: new Abstract: Cross-modal knowledge distillation (CMKD) studies how a (large) teacher model trained on one type of data (e.
Hugging Face Trending Papers
Jun 9
Cross-Modal Knowledge Distillation without Paired Data: Theoretical Foundation and Algorithm
Cross-modal knowledge distillation (CMKD) studies how a (large) teacher model trained on one type of data (e. g.
arXiv Computer Vision
Sep 11
CLIP-RD: Relational Distillation for Efficient CLIP Knowledge Distillation
CLIP-RD introduces a relational distillation framework for efficient CLIP knowledge distillation, featuring Vertical Relational Distillation (VRD) and Cross Relational Distillation (XRD). VRD aligns intra‑modal similarity distributions between teacher and student, while XRD aligns cross‑modal similarity distributions to enforce bidirectional symmetry. This joint modeling of multidirectional relational structures improves the student’s embedding geometry, yielding a 1.8%p performance gain over CLIP‑KD across various architectures, tasks, and corruption settings with minimal training‑time overhead.
arXiv AI
Jul 7
SpectralGCD: Spectral Concept Selection and Cross-modal Representation Learning for Generalized Category Discovery
arXiv:2602. 17395v2 Announce Type: replace-cross Abstract: Generalized Category Discovery (GCD) aims to identify novel categories in unlabeled data while leveraging a small labeled subset of known classes.
arXiv Computation and Language
Aug 24
When Better Teachers Don't Make Better Students: Revisiting Knowledge Distillation for CLIP Models in VQA
arXiv:2511.17886v2 Announce Type: replace-cross Abstract: Vision-language models (VLMs) have achieved remarkable success across multimodal tasks, yet their substantial computational demands hinder ef...
arXiv Computer Vision
Aug 27
MLLMCLIP: Feature-Level Distillation of MLLM for Robust Vision-Language Representations
MLLMCLIP introduces a heterogeneous distillation framework that transfers multimodal knowledge from a generative Multimodal Large Language Model (MLLM) teacher directly into a discriminative CLIP student, eliminating the need for synthetic hard negatives. The method uses an attention-based per-layer token selection and a CKA-based distillation loss to bridge architectural differences between the two models. As a result, MLLMCLIP achieves state‑of‑the‑art compositional accuracy and improves zero‑shot classification and image‑text retrieval performance.