arXiv AI
GUARD: Guided Unlearning and Retention via Data Attribution for Large Language Models
Read the original on arXiv AI →The Flow has not summarised this story yet — read it at arXiv AI.
Related stories
arXiv Machine Learning
Jun 5
SHRED: Retain-Set-Free Unlearning via Self-Distillation with Logit Demotion
arXiv:2605. 07482v2 Announce Type: replace Abstract: Machine unlearning for large language models (LLMs) aims to selectively remove memorized content such as private data, copyrighted text, or hazardous knowledge, without costly full retraining.
arXiv AI
Sep 11
Forgetting Only What Matters: Layer-Selective Unlearning toward Robust LLMs
The paper introduces Forgetting Only What Matters via Unlearning Layers (FOM-UL), a layer‑selective unlearning framework for large language models. FOM-UL uses a forget‑to‑retain significance score to identify transformer layers that strongly influence the forget set while being insensitive to the retain set, allowing targeted updates that preserve most of the model. Experiments on TOFU, KnowUnDo, and MUSE-style benchmarks show that FOM-UL reduces residual memorization and maintains utility better than several baselines, even after 8‑bit and 4‑bit post‑training quantization, and it also limits recovery of forgotten content in adversarial prompt tests.
Hugging Face Trending Papers
Sep 9
Forgetting Only What Matters: Layer-Selective Unlearning toward Robust LLMs
Large Language Models (LLMs) can memorize and reproduce sensitive, copyrighted, or otherwise undesirable training content, creating privacy, safety, and regulatory concerns. Machine unlearning offers...
arXiv Machine Learning
1d ago
CoLU: Confidence-Weighted Layerwise Unlearning for Large Language Models
arXiv:2610.22721v1 Announce Type: cross Abstract: Large language model (LLM) unlearning aims to forget certain information while preserving others, without retraining from scratch. SoTA methods such...
arXiv Machine Learning
Jun 25
Distribution Preference Optimization: A Fine-grained Perspective for LLM Unlearning
arXiv:2510. 04773v2 Announce Type: replace Abstract: As Large Language Models (LLMs) demonstrate remarkable capabilities learned from vast corpora, concerns regarding data privacy and safety are receiving increasing attention.
arXiv AI
Jun 3
PURGE: Projected Unlearning via Retain-Guided Erasure
arXiv:2606. 03808v1 Announce Type: cross Abstract: We propose PURGE, a machine unlearning algorithm built on a simple but an under-exploited observation: continual learning (CL) and machine unlearning (MU) which are fundamentally dual problems.