arXiv AI By Xianren Zhang, Delvin Ce Zhang, Dongwon Lee, Suhang Wang

PPE-Bench: A Benchmark for Evaluating MLLM Unlearning under Private-Public Entanglement

Read the original on arXiv AI →

arXiv:2607. 02897v1 Announce Type: cross Abstract: Multimodal Large Language Models (MLLMs) have shown strong capabilities, but they may memorize private information from web data, raising privacy concerns.

Machine-generated by The Flow from the publisher's headline and feed description — not written or checked by a human. The full article lives at arXiv AI.

arXiv Machine Learning
Aug 20

On the Robustness of Vision-Language Models in Zero-shot Privacy Classification

The paper investigates whether large, instruction‑following Vision‑Language Models (VLMs) can reliably perform zero‑shot image privacy classification. It compares three open‑source VLMs to specialized privacy models on two public benchmarks, evaluating accuracy, robustness to image degradations (compression, lighting changes, noise), inference speed, and parameter count. The findings show that while VLMs remain robust to perturbations, they are less accurate and significantly slower than smaller, purpose‑built privacy models, indicating that scaling alone does not guarantee effective privacy classification.

By Alina Elena Baia, Alessio Xompero, Andrea Cavallaro