Hugging Face Trending Papers

DuET: Dual Expert Trajectories for Diffusion Image Editing

Read the original on Hugging Face Trending Papers →

Recent diffusion editors perform diverse instruction-based edits while conditioning on the source image at every denoising step. Yet persistent source-image conditioning can limit how fully an edit is executed and how natural the result appears, especially when the target scene diverges substantially from the input.

Machine-generated by The Flow from the publisher's headline and feed description — not written or checked by a human. The full article lives at Hugging Face Trending Papers.

arXiv Computer Vision
4d ago

When Text-to-Image Helps Editing: The Effects of Conditioning During Denoising

Unified models trained for both instruction-based image editing and text-to-image generation typically keep source-image conditioning throughout denoising. This study shows that for some edits, source attention naturally decreases during sampling, suggesting that switching to text-to-image conditioning for short intervals can improve edit quality without sacrificing perceptual preservation. Across three editors and four benchmarks, task switching balances quality and preservation, demonstrating that unified editors benefit from using both conditioning modes they are trained for.

By Lidia Troeshestova, Alexander Ustyuzhanin, Sergey Kastryulin
arXiv Computer Vision
Sep 11

Overpainting: Localized Context-aware Diffusion Image Editing

The paper introduces "overpainting," a localized, context-aware image editing technique that allows users to specify precise or loose editing regions via a trimap. The method adapts a pretrained diffusion model with joint attention and low‑rank adaptation, incorporating attention‑dropout to balance noise, source, and mask inputs. An automated pipeline generates training data by pairing images from language‑based editing models, curating them, and extracting trimaps, enabling the model to perform a wide range of editing tasks.

By Sam Sartor, Iliyan Georgiev, Michael Fischer, Valentin Deschaintre, Pieter Peers