arXiv Computer Vision

CloSeR: Unified Relational Distillation from Closed-Set Teachers for Category Discovery

CloSeR is a plug‑and‑play framework that enhances Generalized Category Discovery (GCD) by injecting closed‑set relational knowledge from a lightweight teacher model. The teacher is built by fine‑tuning adapters on labeled data while keeping the backbone frozen, preserving pretrained priors. Unified Relational Distillation then transfers both global sample‑to‑prototype and local sample‑to‑sample relations to the GCD task, reducing optimization interference and improving performance across six benchmarks with DINO and DINOv2 backbones.

arXiv Computer Vision
Aug 24

Semantically Compatible Knowledge Distillation for Cross-Domain Object Detection with Vision Foundation Models

The paper introduces Semantic Localization-Enhanced Teacher (SLE‑T), a knowledge‑distillation framework that aligns spatial‑scale and semantic features between a Vision Foundation Model (VFM) teacher and a student detector for cross‑domain object detection. SLE‑T employs a lightweight SLE Adapter that injects pretrained local‑texture priors into DINOv2 and reformulates its features into dense, spatially and semantically compatible representations, enabling effective pseudo‑label learning or feature alignment. Experiments on three domain‑adaptive object detection benchmarks show that SLE‑T with DINOv2‑B achieves state‑of‑the‑art performance while using only a quarter of the training time and less GPU memory compared to the larger DINOv2‑G teacher.

By Qifeng Zhang, Ting Xiang, Zeyuan Bai, Changjian Chen
arXiv Machine Learning
2d ago

Reification as a Transferable Vocabulary: Zero-Shot Link Prediction with Vanilla GNNs

The paper introduces a method that transforms knowledge graph facts into a fixed vocabulary representation, where each fact becomes a node linked to its subject, object, and relation type via six meta-relations. Using this representation, standard GNNs (e.g., GAT, GINE, GraphSAGE, R-GCN) trained on a single small graph can achieve zero‑shot link prediction on 40 inductive benchmarks, matching the performance of specialized foundation models like ULTRA. The approach also generalizes to relational databases, enabling foreign‑key prediction without cell values or schema text, and the authors provide code, checkpoints, and evaluation tools for all benchmarks.

By Camille Pradel
arXiv Machine Learning
Jun 17

Rethinking Dataset Distillation for Classification: Do Distilled Sets Outperform Coresets?

arXiv:2606. 18209v1 Announce Type: new Abstract: Dataset distillation (DD) has emerged as a prominent approach in data centric machine learning, aiming to synthesize compact training sets for efficient training by compressing the information in large datasets into a small number of synthetic samples.

By Trisha Mittal, Akshay Mehra, Joshua Kimball
arXiv Computer Vision
Aug 28

G2D: Generative-to-Discriminative Collaborative Inference for Zero-Shot Image Classification

The paper introduces G2D, a training‑free framework that combines a discriminative model (CLIP) for broad candidate retrieval with a generative vision‑language model for fine‑grained, image‑grounded verification. By using CLIP’s top‑K shortlist and a structured prior from candidate names and probabilities, G2D focuses generative reasoning on uncertain samples, achieving an average accuracy of 68.85% across eight benchmarks—higher than both CLIP alone (59.35%) and the standalone generative model (63.11%). The approach also adapts to various generator configurations and extends to other models such as DCLIP, WaffleCLIP, and CuPL.

By Zehua Hao, Fang Liu, Qinliang Wang, Yaoyang Du, Xinyan Huang, Puhua Chen