arXiv Computer Vision

PaintCopilot: Modeling Painting as Autonomous Artistic Continuation

arXiv Computer Vision
Oct 22

Painting Change Map as guidance for generating painting processes

The paper introduces the Painting Change Map, a spatio‑temporal control mechanism that tracks normalized structural changes across a 1,000‑timestep continuum for dynamic video generation of paintings. By encoding localized visual differences into an RGB space, it provides fine‑grained guidance for both forward painting and reverse unpainting processes. Experiments show that this approach outperforms existing control baselines and matches or exceeds state‑of‑the‑art painting methods, especially under oracle conditions.

By Markus Pobitzer, Chang Liu, Niccol\`o Biondi, Nicu Sebe
arXiv Computer Vision
Oct 22

Loomis Painter: Learning Painting Processes by Reversing Image-to-Video Generation

Loomis Painter is a framework that learns painting processes by training on reversed image‑to‑video sequences, preserving reference‑attention behavior and avoiding long‑range dependencies that disrupt pretrained models. It introduces a media‑transfer strategy to decouple input appearance from the target process, enabling generation across different artistic media. Evaluated on a curated dataset of real‑world painting processes, the method outperforms baselines on LPIPS, DINO, and CLIP metrics and receives consistent preference in expert and non‑expert user studies.

By Markus Pobitzer, Chang Liu, Chenyi Zhuang, Teng Long, Bin Ren, Nicu Sebe
arXiv Machine Learning
Oct 15

How Far Can Coding Agents Go in Visual Generation?

The paper investigates general‑purpose coding agents that generate images by writing and executing programs, contrasting them with conventional generative models. On the AgentDrawBench benchmark, these agents excel at preserving structure and meeting precise visual constraints, achieving competitive performance in tasks where compositional accuracy outweighs photorealism, though they fall short in perceptual richness. The study further shows that the agents’ visual code can serve as an external language of thought, retaining substantial information for visual question answering and suggesting an internal, compositionally structured representation that guides visual operations across different drawing interfaces.

By Hengguang Zhou, Yuanhao Ban, Jiaqi Feng, Xiaohuan Pei, Justin Cui, Cho-Jui Hsieh
arXiv Computer Vision
Oct 5

ProgressNet: Sketching and Prompting with a Frozen Text-to-Image Model

ProgressNet is a training‑free framework that enables a frozen text‑to‑image model to follow a sketching session in real time. It allows strokes to be added or erased, prompts to be revised, and produces an updated image in about a second per turn without adding new parameters. The method uses three inference‑time mechanisms—Previous‑Concept Memory, Layer‑Selective K/V Injection, and Banded Adaptive Control—to maintain fidelity and coherence across sketch domains, outperforming existing approaches especially when sketches are partially erased.

By Arkaprabha Basu, Chaitat Utintu, Yi-Zhe Song
Hugging Face Trending Papers
Jul 9

ArtMine: Discovering and Formalizing Artistic Processes

Understanding how artworks are created requires reasoning about the iterative decisions, material operations, and contextual influences that shape artistic production. While recent generative AI systems can synthesize artworks with high fidelity, they primarily model distributions over finished artifacts rather than the creative processes underlying their creation.

arXiv AI
Jul 10

ArtMine: Discovering and Formalizing Artistic Processes

arXiv:2607. 08331v1 Announce Type: cross Abstract: Understanding how artworks are created requires reasoning about the iterative decisions, material operations, and contextual influences that shape artistic production.

By Kaustubh Kumar, Ashutosh Ranjan, Vivek Srivastava, Blessin Varkey, Shirish Karande
Hugging Face Trending Papers
Aug 12

Through Van Gogh's Eyes: Global Style Transfer with Diffusion Mod

Artistic image synthesis aims to recreate the expressive visual identity of a target artist, yet existing methods often fail to capture an artist's global style. Conventional style transfer methods transfer the style of one or a few reference artworks to a content image in a One-to-One manner, making them effective for artwork-level stylization but limited in representing the broader stylistic distribution of an artist.

arXiv Computer Vision
Oct 28

Abstraction in Style: Beyond Texture and Color

The paper introduces Abstraction in Style (AiS), a generative framework that separates structural abstraction from visual stylization. AiS first creates an abstraction proxy that reinterprets a target image’s structure according to the abstraction logic of a given style, then renders this proxy to produce a stylized output. By learning transformations from visual exemplars without explicit geometric supervision, AiS enables a broader range of stylistic transformations, improves controllability, and allows more expressive stylization.

By Min Lu, Yuanfeng He, Anthony Chen, Jianhuang He, Pu Wang, Daniel Cohen-Or, Hui Huang