arXiv Computer Vision

Learning Adaptive and Visually Aligned Conditions for Generative Zero-Shot Learning

The paper proposes Adaptive Attribute Distribution and Visual Structure Alignment (AAVS), a framework that learns dimension‑adaptive attribute distributions and aligns them with visual prototypes to improve generative zero‑shot learning. By jointly modeling semantic diversity and visual structural consistency, AAVS provides more effective generation conditions for unseen classes. Experiments on three benchmarks show that AAVS outperforms existing generative ZSL methods.

arXiv AI
Sep 28

Prompt-Based Continual Compositional Zero-Shot Learning

The paper introduces PromptCCZSL, a framework that enables vision‑language models to continually learn new attributes, objects, and their unique compositions while avoiding forgetting. It uses a frozen VLM backbone with prompt‑based techniques, recency‑weighted multi‑teacher distillation, and several loss functions (CAL, OPL, IDL) to maintain prior knowledge and promote diverse, distinct embeddings. Experiments on UT‑Zappos and C‑GQA show significant performance gains over existing VLM‑based and non‑VLM baselines, establishing a new benchmark for continual compositional zero‑shot learning.

By Sauda Maryam, Sara Nadeem, Faisal Qureshi, Mohsen Ali
arXiv Computer Vision
Sep 15

From Model Patterns to Abstract Semantics in Compositional Zero-Shot Learning

The paper introduces CLEAR, a CLoze-style rEAsoning-based Re-ranking framework for Compositional Zero-Shot Learning. CLEAR treats primitive variations as context-driven activations of concrete visual cues rather than independent entities, extracting conditional variants in a coarse-to-fine manner and performing cloze-style reasoning to infer high-level semantics. Experiments show that CLEAR consistently improves base models and surpasses state-of-the-art methods on the C-GQA and MIT-States datasets.

By Weize Li, Zhicheng Zhao, Fei Su
arXiv AI
Oct 16

UniFGVC: Universal Training-Free Few-Shot Fine-Grained Vision Classification via Attribute-Aware Multimodal Retrieval

UniFGVC introduces a training‑free framework for few‑shot fine‑grained visual classification that reframes the task as a multimodal retrieval problem. It uses a Category‑Discriminative Visual Captioner to generate attribute‑aware textual descriptions, then matches image‑description pairs with category templates via pre‑trained encoders. Experiments on 12 datasets show that UniFGVC consistently outperforms existing CLIP‑based and fully‑supervised MLLM methods, demonstrating the effectiveness of the retrieval paradigm.

By Haiyun Guo, Hongyu Guo, Xiangzhao Hao, Jiarui Guo, Jinqiao Wang, Tat-Seng Chua
arXiv Machine Learning
Oct 2

A Flow Matching Algorithm for Many-Shot Adaptation to Unseen Distributions

The paper introduces Function Projection for Flow Matching (FP‑FM), an algorithm that conditions generative models directly on samples from a target distribution. FP‑FM learns basis functions spanning velocity fields for training distributions and adapts to new distributions via a simple least‑squares projection, enabling efficient sample generation without additional training at inference time. Variants of the method trade expressivity for computational cost by enriching coefficient calculations, and the approach shows markedly better precision and recall than baselines, especially on unseen distributions.

By Tyler Ingebrand, Ruihan Zhao, Kushagra Gupta, David Fridovich-Keil, Sandeep P. Chinchali, Ufuk Topcu
arXiv Computation and Language
Sep 1

UReason: Benchmarking Reasoning-to-Generation Alignment in Unified Multimodal Models

UReason is a benchmark that evaluates how well unified multimodal models (UMMs) align textual reasoning with image generation. It contains 2,000 human‑curated instances across five reasoning‑intensive tasks—Code, Arithmetic, Spatial, Attribute, and Text—and compares direct generation, reasoning‑guided generation, and decontextualized generation. The study finds that while reasoning‑guided generation improves over direct generation, decontextualized generation consistently outperforms it, indicating that the visual semantics in textual reasoning are not reliably reflected in the generated images.

By Cheng Yang, Chufan Shi, Bo Shui, Yaokang Wu, Muzi Tao, Huijuan Wang, Ivan Yee Lee, Yong Liu, Xuezhe Ma, Taylor Berg-Kirkpatrick
arXiv Machine Learning
Oct 9

DVLA-RL++: Dual-Level Vision-Language Alignment with Reinforcement Learning Gating for Few-Shot Learning

DVLA-RL++ introduces Dual-Level Vision‑Language Alignment with Reinforcement Learning Gating for few‑shot learning. It adds complementary semantic purification (CSP) to separate intrinsic from nuisance textual descriptions and counterfactual reinforcement‑learning gating (CRG) to learn layer‑wise fusion strengths. Experiments on standard, fine‑grained, and cross‑domain benchmarks demonstrate state‑of‑the‑art accuracy, improving on DVLA‑RL by an average of 1.4%.

By Wenhao Li, Xianjing Meng, Qiangchang Wang, Zhongyi Han, Yilong Yin, Liqiang Nie
Hugging Face Trending Papers
Jul 6

DiCE-CIR: Direct Composition Learning for Efficient Zero-Shot Composed Image Retrieval

Zero-shot composed image retrieval (ZS-CIR) aims to retrieve a target image from a multimodal query consisting of a reference image and an edit text describing the desired modification. Recent ZS-CIR studies have relied on projection-based methods that map a reference image into pseudo-word tokens in the text embedding space.

arXiv AI
Jun 10

Scone: Bridging Composition and Distinction in Subject-Driven Image Generation via Unified Understanding-Generation Modeling

arXiv:2512. 12675v3 Announce Type: replace-cross Abstract: Subject-driven image generation has advanced from single- to multi-subject composition, while neglecting distinction, the ability to distinguish and generate the correct subject when inputs contain multiple candidates.

By Yuran Wang, Bohan Zeng, Chengzhuo Tong, Wenxuan Liu, Yang Shi, Xiaochen Ma, Hao Liang, Yuanxing Zhang, Wentao Zhang