Beyond Accuracy: A Qualitative Analysis of Vision-Language Models for Hate Speech Detection in Memes

The paper examines how four leading vision‑language models—LLaVA‑7B, Qwen‑VL, GPT‑4o mini, and Claude 3 Haiku—perform in detecting hateful content within memes. It evaluates the models under zero‑shot and few‑shot prompting, focusing not only on classification accuracy but also on the qualitative justifications they generate. The study highlights that these models often overlook contextual nuances, irony, and subtle cues essential for accurately identifying hate speech in memes.

Machine-generated by The Flow from the publisher's headline and feed description — not written or checked by a human. The full article lives at arXiv AI.

• llms
• multimodal
• benchmarks