arXiv Computer Vision
Hierarchical Prompt Learning for Hyperbolic Vision-Language Models
Read the original on arXiv Computer Vision →The Flow has not summarised this story yet — read it at arXiv Computer Vision.
Related stories
arXiv AI
Sep 1
Hyper3-CLIP: Hierarchy-Conditioned Hyperbolic Vision-Language Training
arXiv:2608.29313v1 Announce Type: cross Abstract: CLIP-like vision-language models (VLMs) trained with contrastive objectives learn strong global image-text representations, but their Euclidean embed...
arXiv AI
Jul 7
Learning Taxonomic Trees with Hierarchical Representation Regularization for Large Multimodal Models
arXiv:2607. 02909v1 Announce Type: cross Abstract: Taxonomies provide key information about the semantic relationships between concepts and the inherent organization of vision and language.
arXiv Machine Learning
Oct 21
Hierarchical Semantic Tree Anchoring for CLIP-Based Class-Incremental Learning
The paper introduces HASTEN, a hierarchical semantic tree anchoring framework that enhances CLIP-based class‑incremental learning by incorporating external hierarchical knowledge into hyperbolic space. By treating classes as part of a structured hierarchy rather than isolated labels, HASTEN stabilizes visual and textual feature mappings, reduces feature drift, and mitigates catastrophic forgetting across incremental tasks. Experiments on nine benchmarks demonstrate that HASTEN consistently outperforms existing methods.
arXiv Computer Vision
Sep 22
HyperCLIP++: Fine-tuning CLIP forOpen-vocabulary Semantic Segmentation in Hyperbolic Space
arXiv:2609.24564v1 Announce Type: new Abstract: CLIP, a foundational vision-language model, has emerged as a powerful tool for open-vocabulary semantic segmentation. While freezing CLIP's text encode...
arXiv Computer Vision
Oct 26
Separating Angular Alignment from Radial Ordering in Hyperbolic Vision-Language Models
The paper introduces AURORA, a hyperbolic vision‑language framework that separates angular alignment from radial ordering. Angular alignment captures semantic similarity while a novel Radial‑Angular Order Cone (RAOC) models hierarchical entailment based on parent‑child radial gaps. The approach includes norm regularization to prevent radial degeneration and is evaluated on large image‑text datasets, outperforming both Euclidean and hyperbolic baselines in zero‑shot classification, retrieval, hierarchical reasoning, and compositional understanding.
arXiv Computer Vision
Aug 26
What Does Prompt Learning Change? -A Natural-Language Concept Analysis of Vision-Language Models
Prompt learning modifies vision‑language models by optimizing continuous prompt vectors, yet the resulting prompts are hard to interpret in natural language. PromptSpLiCE is a post‑hoc method that rewrites each class‑conditioned text embedding as a sparse mix of concepts from a fixed dictionary, enabling a direct comparison of concept profiles before and after prompt learning. Across 11 image‑classification datasets, the method shows that only about 1.6 of the initial top‑10 concepts remain after learning, and that larger profile changes correlate with higher accuracy gains, while a derived gradient expression offers geometric insight into loss sensitivity.