← Back to all news
arXiv AI By Aleksandra Urman, Elsa Lichtenegger, Salima Jaoua, Azza Bouleimen, Robin Forsberg, Corinna Hertweck, Stefania Ionescu, Nicol\`o Pagan, Ancsa Hannak, Joachim Baumann

Prompt Revision as a Source of Cultural Bias in Text-to-Image Systems

Read the original on arXiv AI →

The paper "Prompt Revision as a Source of Cultural Bias in Text-to-Image Systems" investigates how commercial text‑to‑image models silently modify user prompts before generating images, a step that is often hidden from users. Using the multilingual benchmark WORLDVIEW, the authors audit the revision layer in DALL‑E‑3, Imagen‑4, and GPT‑Image‑1.5, finding that non‑Western and non‑Anglophone contexts are disproportionately marked, reduced to narrow vocabularies, and stereotyped. The study demonstrates that the revision layer itself is a previously undocumented causal source of cultural stereotyping, underscoring the need to audit deployed systems rather than just the underlying models.

Machine-generated by The Flow from the publisher's headline and feed description — not written or checked by a human. The full article lives at arXiv AI.

Related stories

arXiv AI
Oct 27

Beyond Words Alone: Disentangling Distributed Evidence for Visually Grounded Cultural Translation

The paper introduces Culture-MMT, a benchmark for evaluating how well machine translation systems can reconstruct meaning from distributed evidence in social‑media posts. It contains 498 curated, de‑identified user‑generated content instances across 20 domains, classified into Symbol, Visual, and Hybrid based on the type of evidence required. Experiments with 17 model configurations show that real images significantly improve translation for Visual and Hybrid cases, while random images do not, underscoring the importance of accurate visual grounding and cultural adaptation.

By Dingming Li, Yiwen Qiu, Linjuan Wu, Hongxing Li, Zixuan Wang, Xinze Lyu, Ye Guo, Daoxin Zhang, Zhe Xu, Weiming Lu, Yongliang Shen
benchmarks
More like this →
arXiv Computation and Language
Oct 28

The State and Fate of Multilingual, Contextual Evaluation in the NLP World

The paper audits 51 recent multilingual evaluation benchmarks covering 242 datasets and 219 languages, focusing on coverage, representativeness, and rigor. It finds that while coverage is broad, many languages appear in only one benchmark and entire regions are underrepresented; low‑resource languages face a task equity gap. Representativeness is compromised by heavy reliance on English translations, and rigor is weakened by benchmark contamination and parallel‑corpus overlap. The authors propose concrete recommendations for building evaluation frameworks that are natively constructed, culturally grounded, contamination‑aware, and community‑aligned.

By Manan Uppadhyay, Himanshu Beniwal, Prashant Kodali, Sunayana Sitaram
llmsnlpbenchmarks
More like this →
Hugging Face Trending Papers
Oct 27

The State and Fate of Multilingual, Contextual Evaluation in the NLP World

The paper audits 51 multilingual evaluation benchmarks covering 242 datasets and 219 languages, focusing on coverage, representativeness, and rigor. It finds that while coverage is broad, many languages appear in only one benchmark and entire regions are underrepresented, with low-resource languages evaluated on far fewer tasks than high-resource ones. The study also highlights that most datasets rely on English translations, creating artifacts and limiting cultural relevance, and that benchmark contamination through translation leakage and corpus overlap undermines rigor. Recommendations call for natively constructed, culturally grounded, contamination-aware evaluation frameworks that truly serve the communities they aim to assess.

llmsnlpbenchmarks
More like this →