arXiv Computer Vision

Refinement Is Inherently Editable: Training-Free Prompt-to-Prompt Image Editing with Generative Refinement Network

RefineEdit is a training‑free prompt‑to‑prompt image editing framework that uses a Generative Refinement Network to edit images by refining binary image codes. It couples edit localization with content generation, selecting editable positions based on signed probability differences between an editing branch and a source branch, and stabilizes edits with adaptive spatial freezing and finite bit locking. The method requires no additional training, external masks, or attention control, and outperforms other methods on PIE‑Bench in background‑preservation metrics and CLIP scores.

Hugging Face Trending Papers
Jul 23

PC-Edit: Prompt-Contrastive Region Discovery and Region-Guided Editing

Replacing an object with one that differs in category or shape requires complete source removal, natural target formation unconstrained by the source silhouette, and preservation of unrelated content. Existing training-free editors either localize edits from terminal predictions under source and target prompts or preserve unrelated content through spatially unselective source-feature reuse without explicit region discovery.

arXiv Computer Vision
Sep 3

SR-Edit: Region-Aware Image Editing via Self-Refinement

SR-Edit is a new image editing framework that uses iterative self‑refinement to improve fidelity. At each step it extracts precise, self‑consistent region separations from the model’s predictions and then enforces preservation in non‑edit areas with correction updates that stay aligned with the original sampling dynamics. Experiments show that SR‑Edit delivers better preservation and overall image quality than existing editing techniques.

By Andong Wang, Zehua Chen, Yuxuan Jiang, Jun Zhu
arXiv AI
Oct 9

VibeEdit: Image Editing with Canvas Instructions

VibeEdit is a new image‑editing tool that lets users draw spatial marks and add brief notes directly on an image to create a canvas instruction. These instructions guide the model to perform tasks such as adding, removing, replacing, or moving objects, as well as modifying attributes, without needing a separate text prompt. The system is trained on 1.55 million annotated edit pairs and uses a layer‑decoupled conditioning approach, achieving higher VLM rubric scores and PSNR on a benchmark that tests target selection among similar objects.

By Jinjing Zhao, Fangyun Wei, Yitong Wang, Xiuyu Wu, Yunuo Chen, Yang Yue, Sirui Zhang, Wenbo Wang, Hongyang Zhang, Dong Chen, Yan Lu, Chang Xu
arXiv AI
Oct 28

From Structural Feedback to Prompt Policies: Learning Faithful Text-to-Image Prompt Editors

The paper introduces StruPO, a structure‑aware prompt editor that uses a calibrated scene graph to guide prompt modifications while preserving requested scene attributes. By aligning token edits with graph‑based structural feedback, StruPO learns a reusable editing policy that improves faithfulness and relational fidelity across multiple generation backbones. Experiments on diverse test sets and human studies show consistent gains in image quality and preference, especially for complex relations.

By Wentao Ye, Yali Ye, Zhiqing Xiao, Ru Peng, Xinpeng Ti, Liyao Li, Zhanming Shen, Peng Lu, Jie Zhang, Haobo Wang
arXiv Computer Vision
Sep 4

Region-Constrained Group Relative Policy Optimization for Flow-Based Image Editing

The paper introduces RC‑GRPO‑Editing, a region‑constrained Group Relative Policy Optimization framework for flow‑based image editing. It localizes exploration by decoupling initial noise perturbations to reduce background‑induced reward variance and adds an attention concentration reward to keep cross‑attention focused on the intended editing region. Experiments on CompBench demonstrate consistent gains in instruction adherence within the editing region while better preserving non‑target content.

By Zhuohan Ouyang, Zhe Qian, Wenhuo Cui, Chaoqun Wang
arXiv Computer Vision
Oct 9

Rubric-CEPR: Self-Evolving Image Editing via Reward-Verified Self-Distillation

Rubric-CEPR is a self‑evolving image editing framework that improves a pretrained editor using only its own generated samples, without human‑edited targets or external reward models. It employs a planner to generate structured edit instructions, an editor to produce multiple candidate edits, and a frozen critic that scores each candidate with rubric‑augmented contrastive edit‑preservation rewards, rejecting infeasible candidates via non‑compensatory gates. The best verified candidate is distilled into the editor through lightweight adapter training, yielding measurable performance gains on benchmarks such as Qwen‑Image‑Edit, GEdit‑Bench, and Complex‑Edit.

By Ritesh Thawkar, Shubham Patle, Shravan Venkatraman, Rao Muhammad Anwer
arXiv Computer Vision
4d ago

From Evaluation to Evolution: Benchmarking Image Editing and Evolving Image Models

The paper introduces WeGenEditBench, a benchmark with 2,740 evaluation instances and 148 task types for image editing, focusing on local failure detection and prioritization for model improvement. It also presents WeGenEvoStudio, a multi‑agent harness that supports recursive self‑improvement by diagnosing failures, constructing retrieval‑grounded data, and adapting models. Experiments show that models such as GPT‑Image‑2 and Seedream‑5.0‑Pro excel in single‑image and text‑intensive editing, and evolution experiments demonstrate significant targeted gains on selected benchmarks.

By Jun He, Canmiao Fu, Ying Zhang, Zhipeng Huang, Chenyu Mu, Yazhen Xie, Chen Li, Jing Lyu, Weijia Li, Xiang Zhang
arXiv Computer Vision
Sep 11

Overpainting: Localized Context-aware Diffusion Image Editing

The paper introduces "overpainting," a localized, context-aware image editing technique that allows users to specify precise or loose editing regions via a trimap. The method adapts a pretrained diffusion model with joint attention and low‑rank adaptation, incorporating attention‑dropout to balance noise, source, and mask inputs. An automated pipeline generates training data by pairing images from language‑based editing models, curating them, and extracting trimaps, enabling the model to perform a wide range of editing tasks.

By Sam Sartor, Iliyan Georgiev, Michael Fischer, Valentin Deschaintre, Pieter Peers