arXiv AI
Sep 3

Blending Concepts: Benchmarking Visual Metaphor Generation in Text-to-Image Models

The paper introduces VMetaphor-Bench, a benchmark for evaluating visual metaphor generation in text-to-image models, comprising 1,500 curated metaphors across three levels and ten categories, each paired with two prompts of varying specificity. It proposes a hybrid evaluation framework using a multiple-choice question protocol and dimension-based scoring to assess metaphorical fidelity. Experiments on 11 T2I models show that even top proprietary models struggle with compositional structuring and cross-domain mapping, underscoring the need for further research in this area.

By Chuer Chen, Zichen Wang, Yi He, Zhengxi Yu, Nan Cao