← Back to all news
arXiv Computer Vision By Markus Pobitzer, Chang Liu, Niccol\`o Biondi, Nicu Sebe

Painting Change Map as guidance for generating painting processes

Read the original on arXiv Computer Vision →

The paper introduces the Painting Change Map, a spatio‑temporal control mechanism that tracks normalized structural changes across a 1,000‑timestep continuum for dynamic video generation of paintings. By encoding localized visual differences into an RGB space, it provides fine‑grained guidance for both forward painting and reverse unpainting processes. Experiments show that this approach outperforms existing control baselines and matches or exceeds state‑of‑the‑art painting methods, especially under oracle conditions.

Machine-generated by The Flow from the publisher's headline and feed description — not written or checked by a human. The full article lives at arXiv Computer Vision.

Related stories

arXiv Computer Vision
Oct 22

Loomis Painter: Learning Painting Processes by Reversing Image-to-Video Generation

Loomis Painter is a framework that learns painting processes by training on reversed image‑to‑video sequences, preserving reference‑attention behavior and avoiding long‑range dependencies that disrupt pretrained models. It introduces a media‑transfer strategy to decouple input appearance from the target process, enabling generation across different artistic media. Evaluated on a curated dataset of real‑world painting processes, the method outperforms baselines on LPIPS, DINO, and CLIP metrics and receives consistent preference in expert and non‑expert user studies.

By Markus Pobitzer, Chang Liu, Chenyi Zhuang, Teng Long, Bin Ren, Nicu Sebe
diffusionfine-tuning
More like this →
arXiv AI
Oct 9

VINCIE-NExT: Unlocking Video Editing from Images via In-Context Modeling

VINCIE‑NExT is a unified framework that transfers image editing capabilities to video editing by using in‑context visual demonstrations. It decomposes video editing into a chain of sub‑tasks (Video → Image → Image → Video), routing editing intent through the image domain and enabling joint training from heterogeneous image and video data under a single diffusion objective. The method introduces a novel position encoding to link image demonstrations and video frames, allowing pixel‑faithful appearance propagation, and supports test‑time scaling through progressive diffusion stages.

By Leigang Qu, Feng Cheng, Ziyan Yang, Bangbang Yang, Zhaoyang Huang, Wei Chow, Yicong Li, Wenjie Wang, Tat-Seng Chua, Yan Zeng
diffusionbenchmarks
More like this →