arXiv Computer Vision

Whose Face Is It Anyway? A Multi-Model Audit of Facial Affect Recognition on Children, and Why the Gap Is the Head, Not the Features

The paper audits five AffectNet‑pretrained facial affect models on child faces, revealing that all models perform worse on naturalistic child images and consistently confuse fear with surprise. The degradation is linked to specific expression morphologies—particularly open‑mouth faces—and to South‑Asian children, rather than skin tone. A linear probe shows that most of the gap lies in the classifier head, and fine‑tuning just this head on a small amount of child data improves performance by up to 28% on the largest child datasets.

arXiv Computer Vision
6d ago

Out of the box age estimation through facial imagery: A Comprehensive Benchmark of Vision-Language Models vs. out-of-the-box Traditional Architectures

arXiv:2602.07815v3 Announce Type: replace Abstract: Facial age estimation plays a critical role in content moderation, age verification, and deepfake detection. However, no prior benchmark has system...

By Simiao Ren (Manlin), Xingyu Shen (Manlin), Ankit Raj (Manlin), Albert Dai (Manlin), Caroline (Manlin), Zhang, Yuan Xu, Zexi Chen, Siqi Wu, Chen Gong, Yuxin Zhang
arXiv AI
Oct 19

Happy Young Women, Grumpy Old Men? Emotion-Driven Demographic Biases in Synthetic Face Generation

The study audits eight text-to-image models (four Western, four Chinese) by generating 56,000 synthetic faces under neutral and six emotion prompts. It finds pervasive demographic biases: young and White-coded faces are overrepresented, while combinations like young female Black faces are nearly absent. Emotion prompts further skew outputs, with negative emotions favoring White, middle-aged, male-coded faces and lower perceived attractiveness. The research highlights the need for intersectional, emotion‑conditioned, multilingual audits before deploying such models.

By Mengting Wei, Aditya Gulati, Guoying Zhao, Nuria Oliver
arXiv AI
Sep 4

WELD: The First Naturalistic Long-Period Small-Team Workplace Emotion Dataset for Ubiquitous Affective Computing

WELD is the first dataset that combines long‑term (30.1 months), naturalistic workplace recordings, a stable small‑team social structure, and a fully passive sensing protocol approved by institutional review boards. It contains 733,780 per‑frame seven‑class facial‑expression probability vectors from 49 employees of a Chinese software company, making it the longest in‑the‑wild emotion corpus that supports both within‑individual longitudinal and within‑team relational analyses. The authors validate the corpus by reproducing known affective phenomena and report four novel findings, including variance decomposition of daily valence, hidden Markov emotional regimes, turnover prediction metrics, and systematic over‑prediction of “angry” on neutral Asian faces by an off‑the‑shelf FER model.

By Xiao Sun
arXiv Computation and Language
Oct 7

The Failure Is in the Readout: Fine-Grained Emotion Recognition Benchmarks Measure Elicitation, Not Perception

The paper introduces EmoNet‑Face‑HQ, a fine‑grained emotion recognition benchmark that uses generated portraits and a 40‑category taxonomy to evaluate vision‑language models (VLMs). It finds that VLMs perform poorly when asked to generate responses but can match or surpass a fine‑tuned model (Empathic‑Insight‑Face) when their logits are read directly as binary queries. The study shows that the benchmark’s difficulty lies in the readout process rather than in perception, and that graded probability outputs yield better performance than simple yes/no questions.

By Tobias Hallmen, Fabian Deuser, Robin-Nico Kampa, Norbert Oswald, Elisabeth Andr\'e
arXiv Machine Learning
Sep 22

Replicating the Geometry of Emotion Representations in a Base Open-Weights Model

Sofroniew et al. (2026) showed that emotion concepts in Claude Sonnet 4.5 are encoded as vectors whose geometry mirrors human affect psychology. This study replicates that finding using the base pretrained model google/gemma-2-27b, generating 205,200 Claude Sonnet 4.5 stories, extracting 171 emotion vectors, and recovering a similar affective circumplex with principal components explaining comparable variance. The analysis further identifies a sharp geometric seam at layers 22‑26, demonstrates that much of the geometry already exists in static token embeddings, and shows that the geometry predicts token‑level co‑activation with high correlation.

By Adam Hollowell