Hugging Face Trending Papers

SaTPO: Text-to-Image Safety Alignment via Transition Preference Optimization

arXiv Computer Vision
3d ago

Decoupled Safety Control: A Safety-Control Algorithm for Training-Free Safety Guidance

Decoupled Safety Control (DSC) is a plug‑in algorithm that improves training‑free safety guidance for diffusion models by separating the unsafe condition from the intervention process. Unlike existing coupled safety‑control chains, DSC determines the intervention based on the current generation state, reducing residual unsafe content and preserving benign‑generation quality. Experiments on standard safety benchmarks demonstrate that DSC achieves stronger unsafe‑content suppression while maintaining efficient inference.

By Huilin Zhou, Ruoxi Cheng, Yuhang Wang, Yuming Liu, Minghao Sun, Ruolong Ma, Lan Zhang
arXiv AI
Jun 17

Pulling The REINS: Training-Free Safety Alignment of Video Diffusion Models via Representation Steering

arXiv:2606. 17257v1 Announce Type: cross Abstract: Open-weight video diffusion models can generate photorealistic unsafe content, from violence to misinformation, yet existing defenses either require expensive safety fine-tuning that degrades general capability, or apply external filters that are trivially bypassed by adversarial prompts.

By Rohit Kundu, Arindam Dutta, Sarosij Bose, Athula Balachandran, Amit K. Roy-Chowdhury
arXiv AI
Oct 5

Keep It CALM: Analyzing the Limits of Global Unsafety in Text-to-Image Generation

The paper examines the limitations of global unsafety signals used in training‑free safeguards for text‑to‑image generation, showing a trade‑off between coverage and selectivity. It introduces CALM, a counterfactual adaptive local modulation method that locally corrects unsafe token representations while preserving benign content. Experiments demonstrate that CALM outperforms global removal approaches in suppressing unsafe content without compromising utility.

By NaHyeon Park, Minhyun Lee, Hyunjung Shim
Hugging Face Trending Papers
Aug 19

When Safety Overrides Vision: Exploring Dynamics between Vision Influence and Safety Alignment in Vision-Language Models

Aligned vision‑language models (VLMs) are designed to combine grounded visual reasoning with safe generation. The study finds that when safety constraints are applied, these models often abstain from answering questions that they could answer under default instruction, yet visual evidence continues to influence the decoding process. The authors show that safety‑induced abstention alters late‑stage hidden‑state dynamics, and that targeted interventions can restore grounded answering without retraining or changing visual inputs.