arXiv Computer Vision
Sep 21

SafeStyle: Calibrated Style Residual Injection for Controllable Style-Leakage Trade-off in Diffusion Stylization

SafeStyle is a training‑free framework that injects calibrated style residuals into frozen diffusion models for reference‑guided stylization. It estimates style‑supported and content‑associated subspaces from small calibration sets, then transports purified style evidence across adaptive spatial granularity while limiting its influence with a residual‑norm budget. Experiments on texture‑ and geometry‑dominant styles show high DINO style similarity (0.432–0.474) with minimal semantic leakage (0.8%).

By Zhangping Yang, Min Li, Song Yan, Rong Gao, Xinliang Bi, Guanye Xiong, Yujie He
arXiv Computer Vision
6d ago

Transfer the Style, Not the Semantics: Mitigating Semantic Leakage in Image-Guided Stylization

The paper introduces SuRe, a framework that mitigates semantic leakage in image-guided zero-shot style transfer by regulating key–value coupling in diffusion model self‑attention. SuRe disrupts the native correspondence between style keys and values through a value shuffle technique, then progressively recouples them to preserve style fidelity while improving content similarity. Experiments on SD1.5, SDXL, SD3, and FLUX.1‑dev show that SuRe outperforms 18 existing methods in maintaining style similarity and consistently enhancing content similarity, with natural generalization to multi‑style transfer.

By Haojun Tang, Qiwei Lin, Tongda Xu, Wenda Zhao, Yian Zhao, Yu Zhang, Lida Huang, Yan Wang