arXiv Computer Vision

IS-Diff: Improving Diffusion-Based Inpainting with Better Initial Seed

The paper introduces IS‑Diff, a training‑free diffusion‑based inpainting method that improves semantic consistency by using initial seeds sampled from unmasked regions. It incorporates a dynamic selective refinement mechanism to adjust the initialization strength during intermediate latent stages. Experiments on CelebA‑HQ, ImageNet, and Places2 show that IS‑Diff outperforms state‑of‑the‑art methods across standard and large‑mask inpainting tasks.

arXiv AI
Oct 7

D3S2: Diffusion-Guided Dataset Distillation for Semantic Segmentation

The paper introduces D3S2, a diffusion‑guided dataset distillation framework tailored for semantic segmentation. It tackles long‑tailed class imbalance, pixel‑wise alignment, and high computational cost by first selecting class‑balanced masks and then synthesizing images with a pretrained diffusion model conditioned on those masks. Guided diffusion sampling further refines the data with segmentation‑consistency and class‑wise feature matching losses, achieving superior performance at a 1% compression rate on ADE20K and COCO‑Stuff.

By Wenjie Zheng, Haoji Hu, Jiali Lu, Xingze Zou, Jing Wang
Hugging Face Trending Papers
Sep 3

EraseSAE: Surgical Concept Erasure in Text-to-Video Diffusion Models via Sparse Autoencoders

EraseSAE introduces a surgical concept erasure method for text-to-video diffusion models, using sparse autoencoders to decompose activations into interpretable, monosemantic features. The framework employs a contrastive attribution mechanism to isolate concept-specific kernels and applies timestep-resolved masks during inference to remove target concepts while preserving unrelated content. Experiments show that EraseSAE achieves precise, robust concept removal with minimal quality loss, outperforming existing methods.

arXiv Computer Vision
Sep 2

Training-Free Inpainting Across Domains with a Frozen Text-to-Image Diffusion Model

The paper demonstrates that a frozen generic text‑to‑image diffusion model can perform conditional inpainting across three natural‑image domains without any inpainting‑specific training or dataset adaptation. The proposed Step‑PI method augments known‑region projection with boundary‑interior latent feedback, persistent PI state, and a predefined four‑field release schedule, improving all evaluated metrics over baseline training‑free approaches. Experiments on CelebA‑HQ, AFHQ, and Places2 show consistent gains, with Step‑PI outperforming LanPaint and PILOT on all five macro metrics.

By Zhenhuan Wang, Fengyi Yuan
arXiv Computer Vision
Sep 11

Overpainting: Localized Context-aware Diffusion Image Editing

The paper introduces "overpainting," a localized, context-aware image editing technique that allows users to specify precise or loose editing regions via a trimap. The method adapts a pretrained diffusion model with joint attention and low‑rank adaptation, incorporating attention‑dropout to balance noise, source, and mask inputs. An automated pipeline generates training data by pairing images from language‑based editing models, curating them, and extracting trimaps, enabling the model to perform a wide range of editing tasks.

By Sam Sartor, Iliyan Georgiev, Michael Fischer, Valentin Deschaintre, Pieter Peers
arXiv AI
Oct 15

Correction Training for Diffusion Models

arXiv:2610.14136v2 Announce Type: new Abstract: Iterative sampling in diffusion models can lead to error accumulation due to exposure bias. The denoiser is trained on real images interpolated with no...

By Donghoon Ahn, Runqian Wang, Alexei A. Efros, Taesung Park, Yash Belhe
arXiv Computer Vision
Sep 3

Structured-Prior-Guided Diffusion Inpainting with Physical Consistency for Traffic Sign Augmentation

The paper introduces a structured‑prior‑guided diffusion inpainting framework that enhances traffic sign augmentation by incorporating semantic, appearance, and geometric priors through text prompts, vector templates, and ControlNet. It enforces physical consistency with colour and edge‑structure losses, achieving superior reconstruction fidelity and OCR accuracy compared to larger models. The synthetic data generated improves detection performance for rare traffic sign classes by up to 7.4× over a real‑data‑only baseline.

By Luo Li, Chongchong Huang, Jun Jia, Qiang Gao, Xinlong Liu, Gui Yang, Liang Cao