arXiv Machine Learning By Harvey Mannering, Zhiwu Huang, Adam Pr\"ugel-Bennett

Attractive Faces Skew Text-to-Image Reward Models and Leaderboards

Read the original on arXiv Machine Learning →

The paper shows that in text‑to‑image evaluation, human preference for attractive faces can outweigh objective image quality, leading to biased rankings and model outputs. A user study revealed that annotators consistently rate more attractive faces as higher quality, even when comparing real photographs of equal fidelity. This bias can invert leaderboard rankings, dominate preference model scores, and cause generated faces to shift toward younger, more feminine features, undermining user control.

Machine-generated by The Flow from the publisher's headline and feed description — not written or checked by a human. The full article lives at arXiv Machine Learning.

arXiv Computer Vision
Sep 3

Beauty is in the AI of the beholder: MLLMs systematically overrate facial attractiveness

Beauty assessments from Multimodal Large Language Models (MLLMs) are increasingly popular, prompting a study comparing 2,513 human ratings to four commercial AI models—Claude, Gemini, GPT, and Grok. The study found that MLLMs consistently rate faces more favorably and with a narrower range than humans, yet they maintain strong correlations with human judgments and accurately track the rank‑ordering of faces. While all models agree strongly with each other, Grok showed the lowest agreement with human ratings, and only face age emerged as a common predictor of attractiveness across humans and MLLMs.

By Santiago Grandas, Juan Sebastian Cely-Acosta, Mohit Mendiratta, Shafee Hassan, Macken Murphy
arXiv Computer Vision
Oct 19

Generative AI Produces and Transmits Beauty Bias

The paper audits 27 text‑to‑image generators released between 2022 and 2026, examining 51,300 AI‑generated faces and 160,196 real photographs. Using automated metrics and 550 human raters, it finds that AI‑generated faces consistently score higher on attractiveness than real faces, with female‑prompted images often surpassing professional models and darker‑skinned groups receiving lower scores. A preregistered hiring simulation shows that exposure to AI‑generated attractive faces reduces hireability and trustworthiness ratings for real candidates, whereas retouched photographs have no such effect.

By AJ Alvero, Deepak Varuvel Dennison, Alexandra Crespin, Heeyon Kim, Alejandra Regla-Vargas, Avani Akerkar, Jasmine McNealy, Ren\'e Kizilcec
arXiv AI
Jun 3

TASTE: A Designer-Annotated Multi-Dimensional Preference Dataset for AI-Generated Graphic Design

arXiv:2605. 20731v2 Announce Type: replace-cross Abstract: Text-to-image models now generate graphic design at production scale, yet their supervision still comes primarily from photo-style preference datasets with a single overall verdict per comparison.

By Haonan Zhu, Elad Hirsch, Alexandria Minetti, Allison Nulty, Purvanshi Mehta
arXiv AI
Oct 5

Post-Training Frontier Text-to-Image Models by Composing Preference and Rubric Rewards

The paper presents a post‑training approach for text‑to‑image models that combines a preference reward, trained on large human preference data, with rubric‑based rewards that assess prompt faithfulness and other desirable traits. The authors show that a simple reward composition strategy outperforms a naive weighted average, leading to significant Elo gains on the Arena leaderboard for models like Flux2dev and Ideogram‑4. They also release Arena‑T2I‑Training, a 1K subset of data to aid reproducible research in post‑training.

By Yuanhao Ban, I-Hung Hsu, Anastasios Angelopoulos, Wei-Lin Chiang, Ion Stoica, Cho-Jui Hsieh