arXiv AI

PPE-Bench: A Benchmark for Evaluating MLLM Unlearning under Private-Public Entanglement

arXiv:2607. 02897v1 Announce Type: cross Abstract: Multimodal Large Language Models (MLLMs) have shown strong capabilities, but they may memorize private information from web data, raising privacy concerns.

arXiv Machine Learning
Aug 20

On the Robustness of Vision-Language Models in Zero-shot Privacy Classification

The paper investigates whether large, instruction‑following Vision‑Language Models (VLMs) can reliably perform zero‑shot image privacy classification. It compares three open‑source VLMs to specialized privacy models on two public benchmarks, evaluating accuracy, robustness to image degradations (compression, lighting changes, noise), inference speed, and parameter count. The findings show that while VLMs remain robust to perturbations, they are less accurate and significantly slower than smaller, purpose‑built privacy models, indicating that scaling alone does not guarantee effective privacy classification.

By Alina Elena Baia, Alessio Xompero, Andrea Cavallaro
arXiv Computation and Language
Aug 31

AIM: Anchor Identity Features, Then Match for Multimodal Large Language Model Unlearning

The paper introduces AIM, a two‑stage approach for unlearning identity‑specific information from multimodal large language models (MLLMs) when retain images are not available at deletion time. AIM first anchors an identity‑forgetting target using a universal visual prompt, then aligns the vision encoder to this target under a Fisher‑based constraint. Experiments demonstrate that AIM effectively removes identity knowledge while preserving other visual perception capabilities and prior knowledge.

By Wonjun Lee, Jaehyuk Jang, Kangwook Ko, Hee-Seon Kim, Changick Kim
Hugging Face Trending Papers
Jul 7

POPS: Recovering Unlearned Multi-Modality Knowledge in MLLMs with Prompt-Optimized Parameter Shaking

Multimodal Large Language Models (MLLMs) have demonstrated impressive performance on cross-modal tasks by jointly training on large-scale textual and visual data, where privacy-sensitive examples could be unintentionally encoded, raising concerns about privacy or copyright violation. To this end, Multi-modality Machine Unlearning (MMU) was proposed as a mitigation that can effectively force MLLMs to forget private information.