arXiv Computer Vision

Frontier vision-language models have overtaken young adults at detecting AI-generated portraits -- but not their calibration

arXiv Computer Vision
6d ago

Out of the box age estimation through facial imagery: A Comprehensive Benchmark of Vision-Language Models vs. out-of-the-box Traditional Architectures

arXiv:2602.07815v3 Announce Type: replace Abstract: Facial age estimation plays a critical role in content moderation, age verification, and deepfake detection. However, no prior benchmark has system...

By Simiao Ren (Manlin), Xingyu Shen (Manlin), Ankit Raj (Manlin), Albert Dai (Manlin), Caroline (Manlin), Zhang, Yuan Xu, Zexi Chen, Siqi Wu, Chen Gong, Yuxin Zhang
arXiv AI
Oct 21

CounterCount: Diagnosing Knowledge Bias in How Vision-Language Models Count Attributes

CounterCount is a diagnostic dataset that pairs factual and counterfactual images to test whether Vision‑Language Models (VLMs) rely on visual evidence or on world knowledge when counting attributes. Humans achieve near‑perfect accuracy on both types of images, whereas VLMs drop from 91.6% to 49.5% on counterfactuals, often defaulting to canonical counts. The study shows that VLMs exhibit a System‑1‑like bias, underutilize visual evidence, and that targeted input manipulations can mitigate this bias.

By Reem Alzahrani, Bushra Bin Hemid, Hassan Alshanqiti, Zaid Alyafeai, Paul Gavrikov, Bernard Ghanem, Abdelrahman Eldesokey
arXiv AI
5d ago

Physiognomy Revisited: How Vision-Language Models Encode Sensitive Attributes Through Image Transformation

This paper examines how two popular vision‑language models encode protected identities when asked to transform human face images to reflect race and sexual orientation. The authors find that the models often comply with such requests, with compliance being non‑deterministic and group‑sensitive, and that the generated images are statistically distinguishable and tend to reinforce deep‑seated stereotypes. They also show that these representation biases can reappear in textual reasoning tasks and that image generation can perpetuate bias around criminality, raising concerns about AI‑assisted profiling.

By Soumyajit Datta, Arka Dutta, Ashiqur R. KhudaBukhsh