arXiv Computer Vision
HyperCLIP++: Fine-tuning CLIP forOpen-vocabulary Semantic Segmentation in Hyperbolic Space
Read the original on arXiv Computer Vision →The Flow has not summarised this story yet — read it at arXiv Computer Vision.
Related stories
Hugging Face Trending Papers
Jul 15
Fine-grained CLIP fine-tuning with self-annotated region alignment
Contrastive Language-Image Pre-training (CLIP) has been shown to have limitations in its fine-grained dense feature representation, due to its pre-training focusing on matching the whole image to a text description. Considering the large data and computational burden in pre-training a vision-language model from scratch, a series of works aim to enhance the fine-grained ability of CLIP through a fine-tuning scheme.
arXiv AI
Sep 1
Hyper3-CLIP: Hierarchy-Conditioned Hyperbolic Vision-Language Training
arXiv:2608.29313v1 Announce Type: cross Abstract: CLIP-like vision-language models (VLMs) trained with contrastive objectives learn strong global image-text representations, but their Euclidean embed...
arXiv Computer Vision
Oct 7
Unlocking Fine-Grained Perception in CLIP via Structurally-Aware Latent Masked Modeling
arXiv:2610.07689v1 Announce Type: new Abstract: Vision-Language Models (VLMs) such as CLIP excel in global semantic alignment but often lack fine-grained perceptual capabilities. This hinders dense p...
arXiv Computer Vision
Oct 23
ProCLIP: Progressive Vision-Language Alignment via LLM-based Embedder
ProCLIP introduces a curriculum‑learning framework that progressively aligns a CLIP image encoder with an LLM‑based text embedder. It first distills CLIP’s text encoder knowledge into the LLM embedder, then fine‑tunes the image encoder via contrastive learning with self‑distillation, instance semantic alignment, and embedding structure alignment losses. The approach addresses CLIP’s token limit, lack of multilingual support, and preserves pre‑trained vision‑language alignment.
arXiv AI
Jul 31
TraceCLIP: Recovering Local Semantics from Patch-to-CLS Contributions
arXiv:2607. 26107v1 Announce Type: cross Abstract: Dense vision-language understanding, including object localization, region recognition, and open-vocabulary semantic segmentation, requires associating language concepts with spatially grounded visual regions.
arXiv Machine Learning
Jul 20
Rethinking the Global Knowledge of CLIP in Training-Free Open-Vocabulary Semantic Segmentation
arXiv:2502. 06818v4 Announce Type: replace Abstract: Recent works modify CLIP to perform open-vocabulary semantic segmentation in a training-free manner (TF-OVSS).