arXiv Computer Vision
Oct 28

Haste Makes Waste? Towards Safe Few-Step Text-to-Image Models

The paper investigates the safety implications of few-step distilled text-to-image models, finding that faster generation often leads to higher unsafe content rates and that existing concept-erasure methods are less effective on these models. The authors diagnose why erasure fails, attributing it to the fragile generation process and the way guidance is distilled. They propose DICE, a post-distillation erasure technique that aligns with the distillation process, achieving a significant reduction in unsafe-generation rates while preserving quality.

By Lior Ziv, Mahmood Sharif
arXiv AI
Sep 21

GUARD: Natural Forgetting in Large Reasoning Models via Guided Answer-Reasoning Distillation

The paper introduces GUARD, a method for natural forgetting in large reasoning models that transforms unsafe disclosures into safe-exit trajectories using guided answer‑reasoning distillation. It aligns a frozen model with guidance tokens and distills this behavior into the parameters, aiming for a coherent, non‑disclosing chain of thought followed by a refusal‑style answer. The authors also propose the Natural Forgetting Reasoning Score (NFRS) to evaluate structural stability, fluency, and unsupported substitutes, and demonstrate GUARD’s effectiveness on R‑TOFU and a STAR‑1‑derived harmful‑intent setting.

By Zeyu Yan, Guanghao Zhou, Minghui Qiu, Ming Gao, Cen Chen
arXiv Machine Learning
Oct 9

Enabling Preference-driven Unlearning in Few-step Distilled Text-to-Image Diffusion Models

The paper presents a preference-driven unlearning framework for few-step distilled text-to-image diffusion models. It identifies that standard Direct Preference Optimization (DPO) fails on these models due to altered generation dynamics and proposes a modified formulation aligned with few-step properties. The method enables direct concept removal while preserving desirable capabilities, and is evaluated on identity, NSFW, and object-level unlearning tasks with strong forgetting and retention results.

By Gaurav Patel, Jun Fang, Greg Ver Steeg, Qiang Qiu, Sravan Sripada