Hugging Face Trending Papers
Nullify: Null-Space Activation Steering for Training-Free LLM Unlearning
Read the original on Hugging Face Trending Papers →The Flow has not summarised this story yet — read it at Hugging Face Trending Papers.
Related stories
arXiv AI
5d ago
Nullify: Null-Space Activation Steering for Training-Free LLM Unlearning
Nullify is a training‑free method for unlearning sensitive information from large language models by steering activations during inference. It uses steering vectors to redirect privacy‑related activations away from memorized answers while enforcing a null‑space constraint that preserves activations for retained queries, thereby maintaining model utility. Experiments on TOFU and MUSE demonstrate that Nullify matches or outperforms existing baselines in forget quality while keeping utility nearly intact, all without any weight updates.
Hugging Face Trending Papers
Sep 1
Confess What You Know: Forget-Set Misalignment with Model Knowledge in LLM Unlearning
Machine unlearning for large language models (LLMs) often assumes that a pre-defined forget set matches what the model has memorized, but this frequently breaks in realistic privacy settings where the...
arXiv Machine Learning
Jul 13
Forget Narrowly, Retain Broadly: Unlearning as an Asymmetric Generalization Problem
arXiv:2607. 09236v1 Announce Type: new Abstract: Machine unlearning in LLMs is the targeted removal of specific knowledge while preserving all other capabilities, critical for privacy and safety.
arXiv Machine Learning
Jun 5
Learning What to Forget: Improving LLM Unlearning via Learned Token-Level Importance
arXiv:2606. 06320v1 Announce Type: new Abstract: Machine unlearning aims to remove targeted knowledge from a trained model while preserving its general capabilities.
arXiv AI
Sep 2
Confess What You Know: Forget-Set Misalignment with Model Knowledge in LLM Unlearning
The paper identifies a problem in large language model (LLM) unlearning called forget‑set misalignment, where the set of data to be forgotten does not match what the model has actually memorized. Two failure modes are described: Under Unlearning, where memorized information is omitted from the forget set, and Out‑of‑Knowledge Unlearning, where the algorithm attempts to forget knowledge the model never learned, harming performance. The authors propose CONfs, a data‑blind framework that constructs model‑aligned forget sets by eliciting the model’s memorized knowledge, and demonstrate that it achieves near‑gold standard forgetting while preserving utility better than other data‑blind methods.
arXiv AI
Jun 4
ZeroUnlearn: Few-Shot Knowledge Unlearning in Large Language Models
arXiv:2605. 18879v3 Announce Type: replace-cross Abstract: Large language models inevitably retain sensitive information, defined as inputs that may induce harmful generations, due to training on massive web corpora, raising concerns for privacy and safety.