From Concept Erasure to Style Purification: Contrastive Eigenbases for Artist Style Protection
Read the original on arXiv AI →The Flow has not summarised this story yet — read it at arXiv AI.
The Flow has not summarised this story yet — read it at arXiv AI.
Artistic image synthesis aims to recreate the expressive visual identity of a target artist, yet existing methods often fail to capture an artist's global style. Conventional style transfer methods transfer the style of one or a few reference artworks to a content image in a One-to-One manner, making them effective for artwork-level stylization but limited in representing the broader stylistic distribution of an artist.
Abstract‑LoRA introduces a lightweight LoRA training approach that targets specific U‑Net blocks in diffusion models to improve single‑image style transfer. By refining block selection, adding more blocks, and using clustering‑based style abstraction, it better disentangles and balances style and content compared to prior methods like B‑LoRA. Experiments show that the method produces more harmonious artistic images while quantitatively preserving both style and content.
RASteer is a training‑free method for concept erasure in text‑to‑image diffusion models that retains other concepts. It constructs a retain subspace from concepts to preserve, then removes components aligned with this subspace from the erasure direction using Retain‑Orthogonal Steering (ROS). Overlap‑Adaptive Calibration (OAC) further adjusts the removal of shared components at each layer and denoising step, balancing target erasure with concept preservation. Experiments show RASteer matches or outperforms existing activation steering and weight editing baselines on unsafe‑content, instance, and artistic‑style erasure tasks across multiple backbones and benchmarks.
arXiv:2608. 06751v1 Announce Type: cross Abstract: Artist-grounded image generation requires more than appending an artist name to a prompt.
The paper introduces SuRe, a framework that mitigates semantic leakage in image-guided zero-shot style transfer by regulating key–value coupling in diffusion model self‑attention. SuRe disrupts the native correspondence between style keys and values through a value shuffle technique, then progressively recouples them to preserve style fidelity while improving content similarity. Experiments on SD1.5, SDXL, SD3, and FLUX.1‑dev show that SuRe outperforms 18 existing methods in maintaining style similarity and consistently enhancing content similarity, with natural generalization to multi‑style transfer.
arXiv:2609.38136v1 Announce Type: new Abstract: Style transfer aims to render target content in the style of a reference image, but existing methods often suffer from content leakage, where objects,...