Hugging Face Trending Papers

The Forgetting-Retention Dilemma: Certified Unlearning Theory in Continual Learning

Read the original on Hugging Face Trending Papers →

Machine unlearning aims to eliminate the influence of specific data from trained models to safeguard privacy. However, this presents a significant challenge in the context of continual learning (CL), where models update sequentially on dynamic datasets.

Machine-generated by The Flow from the publisher's headline and feed description — not written or checked by a human. The full article lives at Hugging Face Trending Papers.

Hugging Face Trending Papers
4d ago

Preserving Utility in Continual LLM Unlearning via Orthogonal Projections

The paper introduces Continual Orthogonal Projection (COP), a gradient‑projection method that limits each unlearning update to the orthogonal complement of previously cached activation subspaces, thereby preventing interference between successive deletions. COP requires only a low‑rank basis per layer, avoiding the need for past gradients or previous forget sets, and can be applied to any differentiable‑loss unlearning method without altering its objective. Experiments on TOFU and RWKU benchmarks demonstrate that COP maintains model utility across sequential unlearning requests while preserving forgetting effectiveness and preventing collapse of standard objectives.

arXiv AI
Jun 3

PURGE: Projected Unlearning via Retain-Guided Erasure

arXiv:2606. 03808v1 Announce Type: cross Abstract: We propose PURGE, a machine unlearning algorithm built on a simple but an under-exploited observation: continual learning (CL) and machine unlearning (MU) which are fundamentally dual problems.

By Vedant Jawandhia, Daksh Ahuja, Ghufran Alam Siddiqui, Prashant Trivedi, Yash Sinha, Pratik Narang