Where Identity Lives: Localized, Retain-Free Identity Unlearning in Multimodal Large Language Models
Read the original on arXiv Computation and Language →The Flow has not summarised this story yet — read it at arXiv Computation and Language.
The Flow has not summarised this story yet — read it at arXiv Computation and Language.
arXiv:2608.01008v2 Announce Type: replace Abstract: Multimodal large language models (MLLMs) can memorize and disclose sensitive information, motivating machine unlearning to remove designated knowle...
arXiv:2511. 20196v2 Announce Type: replace Abstract: Multimodal large language models (MLLMs) can inadvertently memorize privacy-sensitive information during training.
The paper introduces AIM, a two‑stage approach for unlearning identity‑specific information from multimodal large language models (MLLMs) when retain images are not available at deletion time. AIM first anchors an identity‑forgetting target using a universal visual prompt, then aligns the vision encoder to this target under a Fisher‑based constraint. Experiments demonstrate that AIM effectively removes identity knowledge while preserving other visual perception capabilities and prior knowledge.
The ability of vision-language models (VLMs) to associate visual identities with biographical information creates a need for selective unlearning of personally identifiable information (PII) while pre...
arXiv:2610.01962v1 Announce Type: cross Abstract: The ability of vision-language models (VLMs) to associate visual identities with biographical information creates a need for selective unlearning of...
The paper introduces ADU, a fine‑grained training framework that unlearns sensitive information from large language models by decoupling contextual attention pathways instead of erasing tokens. ADU exploits the distinction between local and global attention heads to identify and suppress attention paths that retrieve persistent sensitive anchors, while preserving local‑attention structure and overall language modeling performance. Evaluation on the TOFU and WMDP benchmarks shows ADU achieves superior forget quality (0.93 on TOFU) and retains 92.9% of model utility compared to 81.9% for existing baselines, with fewer side effects in benign contexts.