Hugging Face Trending Papers

EraseSAE: Surgical Concept Erasure in Text-to-Video Diffusion Models via Sparse Autoencoders

Read the original on Hugging Face Trending Papers →

EraseSAE introduces a surgical concept erasure method for text-to-video diffusion models, using sparse autoencoders to decompose activations into interpretable, monosemantic features. The framework employs a contrastive attribution mechanism to isolate concept-specific kernels and applies timestep-resolved masks during inference to remove target concepts while preserving unrelated content. Experiments show that EraseSAE achieves precise, robust concept removal with minimal quality loss, outperforming existing methods.

Machine-generated by The Flow from the publisher's headline and feed description — not written or checked by a human. The full article lives at Hugging Face Trending Papers.

arXiv AI
Sep 4

EraseSAE: Surgical Concept Erasure in Text-to-Video Diffusion Models via Sparse Autoencoders

EraseSAE is a framework for surgical concept erasure in text-to-video diffusion models. It uses a Partitioned Convolutional Sparse Autoencoder to decompose activations into interpretable sparse features, a contrastive attribution mechanism to isolate concept-specific kernels, and timestep‑resolved masks to confine erasure to active regions. Experiments show precise removal with minimal quality loss, outperforming existing methods.

By Xinghao Wang, Dong Li, Wei Yu, Yingwei Pan, Tao Gong, Qi Chu, Nenghai Yu, Ting Yao
arXiv AI
Oct 26

Concept Acupuncturist: An Efficient and Precise Concept Erasure Method for Diffusion Models via Sparse Autoencoders

Concept Acupuncturist (ConceptACP) is a machine‑unlearning framework that removes targeted concepts from diffusion models efficiently and precisely. It identifies the most relevant cross‑attention block in the U‑Net denoiser, fine‑tunes only that block, and uses Sparse Autoencoders to generate semantically meaningful correction signals for concept erasure. Applied to SDXL‑Turbo, ConceptACP boosts forgetting success by over 36 percentage points while maintaining image quality and prompt fidelity, and works across other Stable Diffusion backbones.

By Yiran Xiahou, Siliang Qin, Kai Chen, Shengzhi Zhang, Renyang Liu
arXiv AI
Sep 18

CleanVideo: Adaptive Concept Erasure for Text-to-Video Diffusion Models

CleanVideo introduces a selective erasure framework for text-to-video diffusion models, addressing the challenge of removing undesired visual concepts from videos. The method uses a low-dimensional subspace intervention guided by a tri-modal gating mechanism that jointly considers spatiotemporal visual features, timestep signals, and textual semantics to decide where, when, and whether to intervene. Experiments on three video diffusion models demonstrate that CleanVideo effectively erases target concepts while preserving visual fidelity, temporal coherence, and outperforming existing baselines in both frame-level and video-level evaluations, even under concept-recovery attacks.

By Junchi Liao, Hongji Li, Wenrui Zhou, Lijie Hu
arXiv Machine Learning
Oct 23

Disentangled Sparse Representations for Concept-Separated Diffusion Unlearning

The paper introduces SAEParate, a sparse autoencoder approach that explicitly separates overlapping concepts in the latent space of text-to-image diffusion models. It employs concept-aware contrastive learning and cross-attention-guided spatial aggregation to focus on concept-relevant regions, while a nonlinear encoder transformation enhances expressive capacity. Experiments on UnlearnCanvas show state‑of‑the‑art performance, especially in challenging joint style‑object unlearning scenarios where prior methods struggle with interference between concepts.

By Hyeonjin Kim, Hangyeol Jung, Heechan Yun, Sungjun Yun, Dong-Jun Han