arXiv Computer Vision

Compositional Concept Erasure in Text-to-Image Diffusion Models via Hierarchically Grounded Semantic Surgery

The paper introduces Hierarchically Grounded Semantic Surgery (HGSS), a training‑free method for removing specific concepts from text‑to‑image diffusion models without altering model weights. HGSS uses hierarchical span grounding to accurately identify target spans and dynamic attribute binding to refine text conditioning during early denoising, thereby preventing routing failures on compositional prompts. Experiments on SEE and UnlearnCanvas show that HGSS significantly reduces hierarchical evasion and attribute leakage, outperforming existing erasure techniques.

arXiv Computer Vision
Oct 2

RASteer: Retain-Aware Activation Steering for Concept Erasure in Diffusion Models

RASteer is a training‑free method for concept erasure in text‑to‑image diffusion models that retains other concepts. It constructs a retain subspace from concepts to preserve, then removes components aligned with this subspace from the erasure direction using Retain‑Orthogonal Steering (ROS). Overlap‑Adaptive Calibration (OAC) further adjusts the removal of shared components at each layer and denoising step, balancing target erasure with concept preservation. Experiments show RASteer matches or outperforms existing activation steering and weight editing baselines on unsafe‑content, instance, and artistic‑style erasure tasks across multiple backbones and benchmarks.

By Yongliang Wu, Haori Lu, Yulun Wu, Jinqi Luo, Xingyu Zhu, Yaoyao Liu
Hugging Face Trending Papers
Jul 6

Erasing Without Collateral Damage: Precise Concept Removal in Diffusion Models

Training-free concept erasure is an attractive mechanism for controlling text-to-image diffusion models, but precise erasure often comes at the cost of damaging semantically related non-target concepts. Existing value-space methods remove the component of each cross-attention value along the target concept direction, implicitly treating target identity and shared visual structure as the same signal.

arXiv Computer Vision
Oct 2

STAGE: Subspace-Targeted Affine Generative Erasure for Text-to-3D Models

STAGE is a training‑free, closed‑form framework for concept erasure in native text‑to‑3D generators. It treats erasure as a stage‑aware editing problem, applying low‑dimensional affine corrections separately to the structural and appearance stages of the pipeline. Experiments on the TRELLIS generator show that STAGE outperforms adapted baselines, achieving a composite score of 66.7 versus 53.2 across 15 shape, material, and object concepts.

By Karol Dziekan, Przemys{\l}aw Spurek, Dawid Malarz
arXiv Computer Vision
Sep 14

GRACE: Adaptive Concept Erasure with Geometry-Guided Retention in Diffusion Models

GRACE is a new framework for concept erasure in text-to-image diffusion models that uses a semantically weighted sensitive subspace to guide localized interventions and lightweight subspace-constrained adapters to avoid global semantic disruption. It replaces manual counterfactual prompts with an automatically decoupled safe-anchor mechanism and controls intervention strength through an energy-driven dynamic gating system. Experiments show GRACE improves NSFW reduction by 17.86% over five state-of-the-art methods while also reducing target CLIP Score and FID, indicating stronger concept suppression with better preservation of generative quality.

By Qinghui Gong, Yihuai Liang, Yuanlun Xie, Deepak Kumar Jain, Vitomir \v{S}truc, Zhengchun Zhou
Hugging Face Trending Papers
Sep 3

EraseSAE: Surgical Concept Erasure in Text-to-Video Diffusion Models via Sparse Autoencoders

EraseSAE introduces a surgical concept erasure method for text-to-video diffusion models, using sparse autoencoders to decompose activations into interpretable, monosemantic features. The framework employs a contrastive attribution mechanism to isolate concept-specific kernels and applies timestep-resolved masks during inference to remove target concepts while preserving unrelated content. Experiments show that EraseSAE achieves precise, robust concept removal with minimal quality loss, outperforming existing methods.

arXiv AI
Sep 4

EraseSAE: Surgical Concept Erasure in Text-to-Video Diffusion Models via Sparse Autoencoders

EraseSAE is a framework for surgical concept erasure in text-to-video diffusion models. It uses a Partitioned Convolutional Sparse Autoencoder to decompose activations into interpretable sparse features, a contrastive attribution mechanism to isolate concept-specific kernels, and timestep‑resolved masks to confine erasure to active regions. Experiments show precise removal with minimal quality loss, outperforming existing methods.

By Xinghao Wang, Dong Li, Wei Yu, Yingwei Pan, Tao Gong, Qi Chu, Nenghai Yu, Ting Yao
arXiv AI
Sep 15

DSS: Dynamic Semantic Steering for Robust Concept Erasure in Diffusion Models

The paper introduces Dynamic Semantic Steering (DSS), a training‑free, inference‑time defense for robust concept erasure in text‑to‑image diffusion models. DSS models local semantic neighborhoods geometrically, automatically identifies benign semantic anchors, and applies context‑aware, constrained feature correction using cross‑attention signals. Experiments show DSS achieves an average erasure rate of 91.0%, outperforming prior defenses while reducing semantic drift and preserving generation fidelity.

By Qinghui Gong, Zhengchun Zhou, Hua Meng, Yihuai Liang, Yuxuan Zhang
arXiv Computer Vision
Sep 28

HyperErase: Scale-Calibrated Hypernetwork for Multi-Concept Erasure in Text-to-Image Models

HyperErase introduces a hypernetwork-based framework for concept erasure in text-to-image models, replacing static adapters with prompt-conditioned parameter synthesis. The method maps textual descriptions to LoRA updates, eliminating per-prompt gradient optimization and manual merging. A decoupled rectification strategy further stabilizes and refines the synthesized adapters, yielding improved erasure effectiveness, image quality, and semantic alignment across diverse concepts.

By Yi Sun, Xinhao Zhong, Zhiqi Zhang, Yimin Zhou, Junhao Li, Yuxia Qiao
arXiv AI
2d ago

No Concept Escapes the Audit: Auditing-Aware Unlearning for Verifiable Concept Erasure in Diffusion Models

The paper introduces AVCE, a method for verifiable concept erasure in diffusion models that audits latent representations to identify vulnerable directions and then edits cross‑attention and self‑attention projections in closed form. By fine‑tuning with pathway‑level auditing losses and orthogonal gradient projection, AVCE reduces attack success rates by 5.07× and improves auditing scores by 3.84× compared to the best baseline while maintaining generation quality.

By Kaiyuan Deng, Yuchen Li, Gen Li, Yang Xiao, Geng Yuan, Xiaoyong Yuan, Bo Hui, Xiaolong Ma