arXiv Computer Vision

Playing Bias: Epistemic Games for Interpreting Text-to-Image Models

The paper "Playing Bias: Epistemic Games for Interpreting Text-to-Image Models" proposes a three-stage, humanities-informed framework—Interpret, Interrogate, and Expose—to make the cultural work of text-to-image (T2I) systems visible and debatable. These epistemic games, tested with undergraduate fine‑arts students, shift discussions from impressionistic reactions to concise, evidence‑based hypotheses, using lightweight classroom tools for reproducibility and structured collaboration. The authors argue that such game‑based approaches foster critical literacy, enabling learners to recognize, discuss, and contest how T2I models encode bias.

arXiv AI
Sep 17

MUSE: Benchmarking Large Vision-Language Models on Multi-Modal Understanding in Situated Education

MUSE is a new benchmark designed to evaluate large vision‑language models on artistic image understanding within situated educational contexts. It separates image annotation from question generation, offering twelve tasks that cover visual perception, semantic and affective interpretation, cultural understanding, and compositional reasoning across diverse artistic images from Singaporean, Southeast Asian, and Western traditions. The benchmark reveals significant gaps in model performance, especially in affective interpretation and compositional reasoning, and highlights common failure modes for trustworthy educational multimodal systems.

By Luyao Zhu, Xun Wei Yee, Wei Li, Mun Thye Mak, Wee Siong Ng
arXiv AI
Sep 12

Prompt Revision as a Source of Cultural Bias in Text-to-Image Systems

The paper "Prompt Revision as a Source of Cultural Bias in Text-to-Image Systems" investigates how commercial text‑to‑image models silently modify user prompts before generating images, a step that is often hidden from users. Using the multilingual benchmark WORLDVIEW, the authors audit the revision layer in DALL‑E‑3, Imagen‑4, and GPT‑Image‑1.5, finding that non‑Western and non‑Anglophone contexts are disproportionately marked, reduced to narrow vocabularies, and stereotyped. The study demonstrates that the revision layer itself is a previously undocumented causal source of cultural stereotyping, underscoring the need to audit deployed systems rather than just the underlying models.

By Aleksandra Urman, Elsa Lichtenegger, Salima Jaoua, Azza Bouleimen, Robin Forsberg, Corinna Hertweck, Stefania Ionescu, Nicol\`o Pagan, Ancsa Hannak, Joachim Baumann
arXiv Machine Learning
Oct 15

How Far Can Coding Agents Go in Visual Generation?

The paper investigates general‑purpose coding agents that generate images by writing and executing programs, contrasting them with conventional generative models. On the AgentDrawBench benchmark, these agents excel at preserving structure and meeting precise visual constraints, achieving competitive performance in tasks where compositional accuracy outweighs photorealism, though they fall short in perceptual richness. The study further shows that the agents’ visual code can serve as an external language of thought, retaining substantial information for visual question answering and suggesting an internal, compositionally structured representation that guides visual operations across different drawing interfaces.

By Hengguang Zhou, Yuanhao Ban, Jiaqi Feng, Xiaohuan Pei, Justin Cui, Cho-Jui Hsieh