arXiv AI By Elena Camuffo, Francesco Barbato, Mete Ozay, Simone Milani, Umberto Michieli

MOCHA: Multi-modal Objects-aware Cross-arcHitecture Alignment

Read the original on arXiv AI →

arXiv:2509. 14001v5 Announce Type: replace-cross Abstract: Personalized object detection aims to adapt a general-purpose detector to recognize user-specific instances from only a few examples.

Machine-generated by The Flow from the publisher's headline and feed description — not written or checked by a human. The full article lives at arXiv AI.

arXiv Computer Vision
Aug 27

MLLMCLIP: Feature-Level Distillation of MLLM for Robust Vision-Language Representations

MLLMCLIP introduces a heterogeneous distillation framework that transfers multimodal knowledge from a generative Multimodal Large Language Model (MLLM) teacher directly into a discriminative CLIP student, eliminating the need for synthetic hard negatives. The method uses an attention-based per-layer token selection and a CKA-based distillation loss to bridge architectural differences between the two models. As a result, MLLMCLIP achieves state‑of‑the‑art compositional accuracy and improves zero‑shot classification and image‑text retrieval performance.

By Jongsuk Kim, Qiyu Wu, Zhuoyuan Mao, Hiromi Wakaki, Junmo Kim, Yuki Mitsufuji
arXiv Computer Vision
Aug 25

Sa2VA: Marrying SAM2 with MLLM for Dense Grounded Understanding of Images and Videos

arXiv:2501.04001v4 Announce Type: replace Abstract: This work presents Sa2VA, the first comprehensive, unified model for dense grounded understanding of both images and videos. Unlike existing multi-...

By Haobo Yuan, Xiangtai Li, Tao Zhang, Yueyi Sun, Zilong Huang, Shilin Xu, Shunping Ji, Yunhai Tong, Lu Qi, Jiashi Feng, Ming-Hsuan Yang
arXiv Computer Vision
Aug 24

Semantically Compatible Knowledge Distillation for Cross-Domain Object Detection with Vision Foundation Models

The paper introduces Semantic Localization-Enhanced Teacher (SLE‑T), a knowledge‑distillation framework that aligns spatial‑scale and semantic features between a Vision Foundation Model (VFM) teacher and a student detector for cross‑domain object detection. SLE‑T employs a lightweight SLE Adapter that injects pretrained local‑texture priors into DINOv2 and reformulates its features into dense, spatially and semantically compatible representations, enabling effective pseudo‑label learning or feature alignment. Experiments on three domain‑adaptive object detection benchmarks show that SLE‑T with DINOv2‑B achieves state‑of‑the‑art performance while using only a quarter of the training time and less GPU memory compared to the larger DINOv2‑G teacher.

By Qifeng Zhang, Ting Xiang, Zeyuan Bai, Changjian Chen