arXiv AI By Jingtao Zhang, Haorui Gao, Youqing Liang, Zeming Liu

Scale-Separated Conditioning for Style-Encoder-Free Diffusion Stylization

Read the original on arXiv AI →

arXiv:2608. 19719v1 Announce Type: cross Abstract: Reference-based diffusion stylization requires separating target geometry from transferable appearance.

Machine-generated by The Flow from the publisher's headline and feed description — not written or checked by a human. The full article lives at arXiv AI.

arXiv AI
Sep 10

MAST: Mask-Guided Attention Control for Training-Free Regional-Multi Style Transfer

MAST (Mask‑Guided Attention Control for Training‑Free Regional‑Multi Style Transfer) is a framework that enables diffusion models to apply multiple reference styles to user‑specified regions of a content image without any training or optimization. It introduces logit‑level attention mass allocation, sharpness‑aware temperature scaling, and discrepancy‑aware detail injection to address mass allocation, selectivity, and detail loss problems in regional‑multi style transfer. Experiments with two to five styles show that MAST outperforms baselines in ArtFID, FID, and R‑FID, achieving high regional style fidelity, content preservation, and scalability.

By Dongkyung Kang, Jaeyeon Hwang, Junseo Park, Minji Kang, Yeryeong Lee, Beomseok Ko, Hanyoung Roh, Jeongmin Shin, Hyeryung Jang
arXiv AI
Sep 3

ContextAnyone: Context-Aware Diffusion for Character-Consistent Text-to-Video Generation

ContextAnyone is a context‑aware diffusion framework that treats a reference image as an explicitly preserved appearance anchor rather than a simple conditioning signal. By jointly reconstructing the reference image and generating the target video within a shared diffusion transformer, it provides direct supervision for maintaining identity and fine‑grained appearance throughout denoising. The method introduces asymmetric information flow and Gap‑RoPE positional representations to keep the reference stable while allowing selective access by video tokens, and demonstrates improved identity and appearance consistency on an OpenVid‑HD benchmark.

By Ziyang Mai, Yu-Wing Tai
arXiv Machine Learning
3d ago

Abstract-LoRA: Unlocking Single-Image Style Transfer through Targeted U-Net Block Training

Abstract‑LoRA introduces a lightweight LoRA training approach that targets specific U‑Net blocks in diffusion models to improve single‑image style transfer. By refining block selection, adding more blocks, and using clustering‑based style abstraction, it better disentangles and balances style and content compared to prior methods like B‑LoRA. Experiments show that the method produces more harmonious artistic images while quantitatively preserving both style and content.

By Xinglin Hu
Hugging Face Trending Papers
Aug 12

Through Van Gogh's Eyes: Global Style Transfer with Diffusion Mod

Artistic image synthesis aims to recreate the expressive visual identity of a target artist, yet existing methods often fail to capture an artist's global style. Conventional style transfer methods transfer the style of one or a few reference artworks to a content image in a One-to-One manner, making them effective for artwork-level stylization but limited in representing the broader stylistic distribution of an artist.

arXiv Computer Vision
Sep 3

Chameleon: Style-Content Disentangled Framework for Cross-Domain Object Compositing

The paper introduces Chameleon, a two‑stage training framework for cross‑domain image compositing that separates style and content representations. It first trains a ChameleonEncoder using Joint Hard Contrastive Learning to disentangle style and content, then applies Spatio‑Temporal Attention Gating within a diffusion transformer to stylize the foreground while preserving its identity. The authors also release ChameleonDataset, the first large‑scale training set for cross‑domain compositing, and demonstrate that Chameleon outperforms existing in‑domain, cross‑domain, and commercial models in both plausibility and stylistic fidelity.

By Sukhun Ko, Soo Ye Kim, Jihyong Oh