arXiv Computer Vision

Local Content-Style Control for Diffusion-based Image Stylization

arXiv AI
Sep 10

MAST: Mask-Guided Attention Control for Training-Free Regional-Multi Style Transfer

MAST (Mask‑Guided Attention Control for Training‑Free Regional‑Multi Style Transfer) is a framework that enables diffusion models to apply multiple reference styles to user‑specified regions of a content image without any training or optimization. It introduces logit‑level attention mass allocation, sharpness‑aware temperature scaling, and discrepancy‑aware detail injection to address mass allocation, selectivity, and detail loss problems in regional‑multi style transfer. Experiments with two to five styles show that MAST outperforms baselines in ArtFID, FID, and R‑FID, achieving high regional style fidelity, content preservation, and scalability.

By Dongkyung Kang, Jaeyeon Hwang, Junseo Park, Minji Kang, Yeryeong Lee, Beomseok Ko, Hanyoung Roh, Jeongmin Shin, Hyeryung Jang
arXiv AI
Jul 22

Appearance Pointers -- Multimodal Region Control of Diffusion Transformers

arXiv:2607. 19344v1 Announce Type: cross Abstract: Controllable image generation remains challenging for creative professionals, who often require precise regional control over materials, object identities, and spatial arrangements that cannot be reliably achieved through text prompting alone.

By Rahul Sajnani, Yulia Gryaditskaya, Radom\'ir M\v{e}ch, Srinath Sridhar, Matheus Gadelha
Hugging Face Trending Papers
Jun 29

UniGP: Taming Diffusion Transformer for Prior-Preserved Unified Generation and Perception

Recent advances in diffusion models have shown impressive performance in controllable image generation and dense prediction tasks. However, existing approaches typically treat diffusion-based controllable generation and dense prediction as separate tasks, overlooking the potential benefits of jointly modeling the heterogeneous distributions.

arXiv AI
6d ago

LociArt: A Unified Paradigm for Free-Style Local Video Stylization

LociArt introduces a unified framework for free‑style local video stylization, allowing precise specification of where to stylize and which style to apply while preserving non‑target content. The core method, GRNStyle, builds on Generative Refinement Networks and uses a polar style‑aware mask to embed style identities as equal‑norm directions within selected regions. An automated pipeline generates paired supervision, leading to the LociArt‑100K dataset and benchmark, which evaluate regional style quality, non‑target preservation, and temporal consistency, and experiments show GRNStyle outperforms existing methods in these aspects.

By Yuxuan Chen, Feng Xie, Jiagao Hu, Fuhao Li, Zepeng Wang, Fei Wang, Daiguo Zhou
arXiv Computer Vision
Sep 28

Motion Style Slider: Endpoint-Supervised Continuous Style Control for Human Motion Diffusion

The paper introduces Motion Style Slider, a framework that enables continuous, endpoint‑supervised control of style intensity in human motion diffusion. By constructing a style direction in a learned motion‑style embedding space and conditioning diffusion generation with a scalar intensity, the method achieves smooth, monotonic style scaling without needing intermediate‑intensity ground truth. The approach is compatible with pretrained diffusion backbones, supports heterogeneous style datasets, and is evaluated on controllability, interpolation/extrapolation, content preservation, and motion realism.

By Chen-Chieh Liao, Yichen Peng, Yiyi Cai, Y\^ui Ono, Hiroki Hanaoka, Erwin Wu, Hideki Koike, Shuichi Kurabayashi