Artistic image synthesis aims to recreate the expressive visual identity of a target artist, yet existing methods often fail to capture an artist's global style. Conventional style transfer methods transfer the style of one or a few reference artworks to a content image in a One-to-One manner, making them effective for artwork-level stylization but limited in representing the broader stylistic distribution of an artist.
arXiv:2412.00176v4 Announce Type: replace
Abstract: We explore whether pre-training on datasets with paintings is necessary for a model to learn an artistic style with only a few examples. To investi...
By Hui Ren, Joanna Materzynska, Rohit Gandikota, Giannis Daras, David Bau, Antonio Torralba
MAST (Mask‑Guided Attention Control for Training‑Free Regional‑Multi Style Transfer) is a framework that enables diffusion models to apply multiple reference styles to user‑specified regions of a content image without any training or optimization. It introduces logit‑level attention mass allocation, sharpness‑aware temperature scaling, and discrepancy‑aware detail injection to address mass allocation, selectivity, and detail loss problems in regional‑multi style transfer. Experiments with two to five styles show that MAST outperforms baselines in ArtFID, FID, and R‑FID, achieving high regional style fidelity, content preservation, and scalability.
By Dongkyung Kang, Jaeyeon Hwang, Junseo Park, Minji Kang, Yeryeong Lee, Beomseok Ko, Hanyoung Roh, Jeongmin Shin, Hyeryung Jang
The paper introduces Chameleon, a two‑stage training framework for cross‑domain image compositing that separates style and content representations. It first trains a ChameleonEncoder using Joint Hard Contrastive Learning to disentangle style and content, then applies Spatio‑Temporal Attention Gating within a diffusion transformer to stylize the foreground while preserving its identity. The authors also release ChameleonDataset, the first large‑scale training set for cross‑domain compositing, and demonstrate that Chameleon outperforms existing in‑domain, cross‑domain, and commercial models in both plausibility and stylistic fidelity.
By Sukhun Ko, Soo Ye Kim, Jihyong Oh
Image style is a highly abstract, human-constructed concept shaped by a range of visual factors and intrinsically entangled with content, yet a unified and explicit definition of image style remains l...
arXiv:2608. 19719v1 Announce Type: cross Abstract: Reference-based diffusion stylization requires separating target geometry from transferable appearance.
By Jingtao Zhang, Haorui Gao, Youqing Liang, Zeming Liu