arXiv Computer Vision

Unmasking Face Embeddings: Reading, Rendering and Naming with Foundation Models

arXiv Computer Vision
Aug 25

EXPL-FR: Explaining Face Recognition Models via Vision-Language Alignment

EXPL-FR is a lightweight adapter that aligns a vision‑language model’s image encoder with a frozen face‑recognition (FR) embedding space, enabling the FR model to be explained using semantic attribute prompts without any text training. By mapping 978 attribute prompts across 22 categories into the FR space, the method identifies the most detectable concepts—forming a readable semantic signature that better separates identities than the full vocabulary. The approach is evaluated on four FR backbones and two VLM encoders, providing identity‑level, per‑image, and differential explanations, and demonstrates that prompt‑driven audits can rank FR models by per‑ethnicity error and attribute‑change verification cost without requiring labeled data.

By Guray Ozgur, Mustafa Efe Tamyapar, Naser Damer, Fadi Boutros
arXiv AI
Sep 18

FORGE: Forensic Reasoning with Grounded Evidence

FORGE is a forensic deepfake analysis system that provides region‑grounded natural language explanations for image manipulations. It addresses the inductive bias mismatch of multimodal large language models by adding a Vision‑Only Model trained on dense patch prediction, allowing the language model to interleave tokens with preserved spatial correspondence. Across face‑manipulated and fully synthetic content, FORGE delivers fine‑grained attribute queries and outperforms in‑domain baselines, with region‑specific evaluation and human studies confirming explanation faithfulness.

By Rohit Kundu, Shan Jia, Vishal Mohanty, Athula Balachandran, Amit K. Roy-Chowdhury
arXiv AI
Aug 12

Towards Unified Dynamic Face Landmark Detection

arXiv:2608. 10346v1 Announce Type: cross Abstract: Although advancements in face landmark detection (FLD) methods continue to push performance boundaries, they overlook two major functional limitations: (1) different network parameters need to be trained independently for each ``$N$-point'' benchmark dataset, and (2) a model trained on an ``$N$-point'' dataset reliably outputs only the $N$ landmarks.

By Sebastian Regalado, Varshanth R. Rao, Ruowei Jiang, Parham Aarabi, Igor Gilitschenski
arXiv AI
Jun 4

CounterFace: A Synthetic Face Dataset for Fine-Grained Counterfactual Evaluation of Face Recognition Systems

arXiv:2407. 13922v3 Announce Type: replace-cross Abstract: Face recognition (FR) systems are widely deployed in critical applications, making their reliability and robustness across diverse populations and conditions essential.

By Guruprasad Viswanathan Ramesh, Ashish Hooda, Shimaa Ahmed, Harrison J Rosenberg, Ramya Korlakai Vinayak, Kassem Fawaz
arXiv Computer Vision
Oct 8

How Private is Private? A Comparative Study for Face De-Identification

The paper introduces a unified evaluation framework for face de-identification (FDeID), addressing inconsistencies in current protocols. It presents UtilFace, a demographically balanced benchmark assembled from four large-scale datasets, and HiFD, a hierarchical metric that simultaneously measures identity suppression, multi-level utility preservation, and image quality. Using this framework, the authors compare adversarial, GAN-based, and diffusion-based methods, revealing trade-offs and failure modes that were previously hidden, and they release the benchmark and toolkit for reproducible research.

By Hui Wei, Hao Yu, Hui Kuurila-Zhang, Guoying Zhao