← Back to all news
arXiv AI By Gautam Rajendrakumar Gare, Jia Shi, Zhiqiu Lin, Deepak Pathak, John Galeotti, Deva Ramanan

Attributes Should Come from Images, Not Class Names: Distribution-Conditioned Attribute Selection for Vision-Language Models

Read the original on arXiv AI →

arXiv:2607. 18695v1 Announce Type: cross Abstract: A popular route to interpretable zero-shot classification asks a large language model (LLM) to describe each class name and prompts CLIP with the resulting descriptors.

Machine-generated by The Flow from the publisher's headline and feed description — not written or checked by a human. The full article lives at arXiv AI.

Related stories

arXiv Machine Learning
Jul 17

CARPRT: Class-Aware Zero-Shot Prompt Reweighting for Black-Box Vision-Language Models

arXiv:2607. 14125v1 Announce Type: new Abstract: Pre-trained vision-language models (VLMs) enable zero-shot image classification by computing the similarity score between an image and textual descriptions, typically formed by inserting a class label (e.

By Ruijiang Dong, Zesheng Ye, Jianzhong Qi, Lei Feng, Feng Liu, Gang Niu, Masashi Sugiyama
llmscomputer-visionmultimodalbenchmarks
More like this →
arXiv Computer Vision
Aug 28

When Semantics Saturate or Emerge: Adaptation-Conditional Semantic Utility in Source-Free Cross-Domain Few-Shot Learning

The paper investigates whether language prompts selected by zero‑shot accuracy remain effective after visual adaptation in source‑free cross‑domain few‑shot learning. Using a paired protocol, the authors compare generic class‑name templates with detailed class descriptions before and after Low‑Rank Adaptation (LoRA) on datasets such as EuroSAT, CropDisease, ISIC, and ChestX. They identify two regimes: semantic saturation, where detailed prompts are already useful before adaptation, and semantic emergence, where detailed prompts become more useful only after visual representation updates, driven by changes in prediction patterns.

By Wei Liu, Xing Deng, Haijian Shao
llmsfine-tuning
More like this →
arXiv Machine Learning
Aug 3

Visual Distribution Anchoring for Efficient Prompt Tuning

arXiv:2607. 28967v1 Announce Type: cross Abstract: Prompt tuning adapts vision--language models with few trainable parameters, but existing approaches trade off efficiency and adaptation: static textual prompts can overfit source classes, image-conditioned prompts add per-instance computation, and multimodal tuning modifies the visual branch.

By Pouya Parsa, Raoof Zare Moayedi, Seongjin Choi
llmsmultimodal
More like this →