arXiv Computer Vision

LOCI: Localized Continuous Control for Multi-Subject Image Editing

arXiv Computer Vision
Sep 16

MDN-Control: Mask-Depth-Noise Guided Region Control for Multi-Subject Video Editing

MDN-Control is a training‑free framework for multi‑subject video editing that jointly controls target localization, occlusion geometry, and appearance initialization. It uses mask‑guided localization for consistent target placement, depth‑aware occlusion control to resolve boundaries between overlapping subjects, and noise‑latent prompting to retrieve Gaussian initializations from a noise library for prompt‑relevant priors. Experiments on MSVBench show that MDN‑Control achieves the lowest CM‑Err and the highest Q‑Edit while maintaining competitive text alignment and temporal consistency.

By Jiayi Yu, Xi Ye, Lina Wang, Yunkun Xia
Hugging Face Trending Papers
Jul 23

PC-Edit: Prompt-Contrastive Region Discovery and Region-Guided Editing

Replacing an object with one that differs in category or shape requires complete source removal, natural target formation unconstrained by the source silhouette, and preservation of unrelated content. Existing training-free editors either localize edits from terminal predictions under source and target prompts or preserve unrelated content through spatially unselective source-feature reuse without explicit region discovery.

arXiv Computer Vision
Aug 25

Reference-free Human-Object Interaction Editing

arXiv:2503.09130v2 Announce Type: replace-cross Abstract: This paper presents InteractEdit, a novel framework for reference-free Human-Object Interaction (HOI) editing that tackles the challenging ta...

By Jiun Tian Hoe, Weipeng Hu, Wei Zhou, Chao Xie, Ziwei Wang, Xudong Jiang, Yap-Peng Tan, Chee Seng Chan
arXiv AI
Oct 9

VibeEdit: Image Editing with Canvas Instructions

VibeEdit is a new image‑editing tool that lets users draw spatial marks and add brief notes directly on an image to create a canvas instruction. These instructions guide the model to perform tasks such as adding, removing, replacing, or moving objects, as well as modifying attributes, without needing a separate text prompt. The system is trained on 1.55 million annotated edit pairs and uses a layer‑decoupled conditioning approach, achieving higher VLM rubric scores and PSNR on a benchmark that tests target selection among similar objects.

By Jinjing Zhao, Fangyun Wei, Yitong Wang, Xiuyu Wu, Yunuo Chen, Yang Yue, Sirui Zhang, Wenbo Wang, Hongyang Zhang, Dong Chen, Yan Lu, Chang Xu
arXiv Computer Vision
Sep 11

Overpainting: Localized Context-aware Diffusion Image Editing

The paper introduces "overpainting," a localized, context-aware image editing technique that allows users to specify precise or loose editing regions via a trimap. The method adapts a pretrained diffusion model with joint attention and low‑rank adaptation, incorporating attention‑dropout to balance noise, source, and mask inputs. An automated pipeline generates training data by pairing images from language‑based editing models, curating them, and extracting trimaps, enabling the model to perform a wide range of editing tasks.

By Sam Sartor, Iliyan Georgiev, Michael Fischer, Valentin Deschaintre, Pieter Peers
arXiv Computer Vision
Sep 18

Refinement Is Inherently Editable: Training-Free Prompt-to-Prompt Image Editing with Generative Refinement Network

RefineEdit is a training‑free prompt‑to‑prompt image editing framework that uses a Generative Refinement Network to edit images by refining binary image codes. It couples edit localization with content generation, selecting editable positions based on signed probability differences between an editing branch and a source branch, and stabilizes edits with adaptive spatial freezing and finite bit locking. The method requires no additional training, external masks, or attention control, and outperforms other methods on PIE‑Bench in background‑preservation metrics and CLIP scores.

By Yulong Chen, Ziqian Zhang, Haoyu Zhang, Ao He, Senmao Li, Kai Wang
arXiv Computer Vision
Sep 4

Region-Constrained Group Relative Policy Optimization for Flow-Based Image Editing

The paper introduces RC‑GRPO‑Editing, a region‑constrained Group Relative Policy Optimization framework for flow‑based image editing. It localizes exploration by decoupling initial noise perturbations to reduce background‑induced reward variance and adds an attention concentration reward to keep cross‑attention focused on the intended editing region. Experiments on CompBench demonstrate consistent gains in instruction adherence within the editing region while better preserving non‑target content.

By Zhuohan Ouyang, Zhe Qian, Wenhuo Cui, Chaoqun Wang
arXiv AI
Oct 9

VINCIE-NExT: Unlocking Video Editing from Images via In-Context Modeling

VINCIE‑NExT is a unified framework that transfers image editing capabilities to video editing by using in‑context visual demonstrations. It decomposes video editing into a chain of sub‑tasks (Video → Image → Image → Video), routing editing intent through the image domain and enabling joint training from heterogeneous image and video data under a single diffusion objective. The method introduces a novel position encoding to link image demonstrations and video frames, allowing pixel‑faithful appearance propagation, and supports test‑time scaling through progressive diffusion stages.

By Leigang Qu, Feng Cheng, Ziyan Yang, Bangbang Yang, Zhaoyang Huang, Wei Chow, Yicong Li, Wenjie Wang, Tat-Seng Chua, Yan Zeng