IDSISA is a new approach to machine unlearning that builds on SISA by using influence functions to group forget‑prone samples into a few shards and then distilling knowledge from unaffected shards to recover lost utility. The method retains SISA’s exact deletion guarantee while providing an empirically bounded approximation for utility recovery (ε_cert ≤ 0.015). Experiments on several image and text models show significant improvements in selective forgetting and utility retention compared to SISA, with modest changes in unlearning time.
By Deeraj SK, Sadhana Devarajan, Tanmoy Hazra, Anupam Shukla
arXiv:2507. 04771v2 Announce Type: replace-cross Abstract: Privacy protection laws, such as the GDPR, grant individuals the right to request the forgetting of their personal data not only from databases but also from machine learning (ML) models trained on them.
By Josep Domingo-Ferrer, Najeeb Jebreel, David S\'anchez
arXiv:2605. 07482v2 Announce Type: replace Abstract: Machine unlearning for large language models (LLMs) aims to selectively remove memorized content such as private data, copyrighted text, or hazardous knowledge, without costly full retraining.
By Zizhao Hu, Ameya Godbole, Johnny Tian-Zheng Wei, Mohammad Rostami, Jesse Thomason, Robin Jia
arXiv:2505. 12239v2 Announce Type: replace-cross Abstract: In Continual Learning (CL), using a Pre-Trained Model (PTM) as the feature extractor has become a popular practice.
By Yajiang Huang, Jianheng Tang, Kejia Fan, Huiping Zhuang, Anfeng Liu, Tian Wang, Yunhuai Liu, Mianxiong Dong, Houbing Herbert Song
arXiv:2506.10946v3 Announce Type: replace-cross
Abstract: Unlearning large language models (LLMs) is important due to copyright and privacy concerns. A key challenge is unintended forgetting, where r...
By Peizhi Niu, Evelyn Ma, Boya Hou, Huiting Zhou, Duo Zhou, Huan Zhang, S. Rasoul Etesami, Olgica Milenkovic
arXiv:2508.20443v3 Announce Type: replace
Abstract: Large language models (LLMs) are trained on massive datasets that may include private or copyrighted content. Due to growing privacy and ownership...
By Zhihao Liu, Jian Lou, Yuke Hu, Xiaochen Li, Yitian Chen, Tailun Chen, Zhizhen Qin, Kui Ren, Zhan Qin
arXiv:2609.05966v1 Announce Type: new
Abstract: Existing unlearning approaches typically rely on post hoc weight adaptation or distillation, leading to duplicated memory costs, degraded generalizatio...
By Kushal Chakrabarti, Mayank Baranwal
arXiv:2606. 03808v1 Announce Type: cross Abstract: We propose PURGE, a machine unlearning algorithm built on a simple but an under-exploited observation: continual learning (CL) and machine unlearning (MU) which are fundamentally dual problems.
By Vedant Jawandhia, Daksh Ahuja, Ghufran Alam Siddiqui, Prashant Trivedi, Yash Sinha, Pratik Narang
The paper introduces auditability as a fourth evaluation axis for machine unlearning, measuring the separation between forgotten and retained data via a statistic computed by the provider. Experiments on eleven unlearning methods across TOFU, MUSE, and RWKU datasets show none satisfy all four axes, prompting the authors to propose a two‑stage approach: GapWiden, which widens the audit statistic gap using a hinge loss, and GapVeil, an inference‑time rejection sampler that refines responses based on audit statistics. The combined method achieves oracle‑level auditability and leakage control for all tested unlearning techniques, while improving retain performance for most methods.
By Piyush Tiwary, Anushka Srivastava, Prathosh A. P
The paper introduces Forgetting Only What Matters via Unlearning Layers (FOM-UL), a layer‑selective unlearning framework for large language models. FOM-UL uses a forget‑to‑retain significance score to identify transformer layers that strongly influence the forget set while being insensitive to the retain set, allowing targeted updates that preserve most of the model. Experiments on TOFU, KnowUnDo, and MUSE-style benchmarks show that FOM-UL reduces residual memorization and maintains utility better than several baselines, even after 8‑bit and 4‑bit post‑training quantization, and it also limits recovery of forgotten content in adversarial prompt tests.
By Ravi Ranjan, Olivera Kotevska, Agoritsa Polyzou
arXiv:2603. 12977v3 Announce Type: replace Abstract: Foundation models are commonly deployed as frozen feature extractors with a small trainable head to adapt to private, user-generated data in federated settings.
By Yijun Quan, Wentai Wu, Giovanni Montana
arXiv:2606. 17122v1 Announce Type: cross Abstract: The demand for privacy-compliant AI has amplified the need for machine unlearning; yet, existing retraining or distillation-based methods remain unverifiable and computationally costly.
By Rutger Hendrix, Leonardo G. Russo, Concetto Spampinato, Matteo Pennisi, Giovanni Bellitto