arXiv Computer Vision By Yongzhe Lyu, Yu Wu, Yutian Lin, Bo Du

IS-Diff: Improving Diffusion-Based Inpainting with Better Initial Seed

Read the original on arXiv Computer Vision →

The paper introduces IS‑Diff, a training‑free diffusion‑based inpainting method that improves semantic consistency by using initial seeds sampled from unmasked regions. It incorporates a dynamic selective refinement mechanism to adjust the initialization strength during intermediate latent stages. Experiments on CelebA‑HQ, ImageNet, and Places2 show that IS‑Diff outperforms state‑of‑the‑art methods across standard and large‑mask inpainting tasks.

Machine-generated by The Flow from the publisher's headline and feed description — not written or checked by a human. The full article lives at arXiv Computer Vision.

arXiv AI
Oct 7

D3S2: Diffusion-Guided Dataset Distillation for Semantic Segmentation

The paper introduces D3S2, a diffusion‑guided dataset distillation framework tailored for semantic segmentation. It tackles long‑tailed class imbalance, pixel‑wise alignment, and high computational cost by first selecting class‑balanced masks and then synthesizing images with a pretrained diffusion model conditioned on those masks. Guided diffusion sampling further refines the data with segmentation‑consistency and class‑wise feature matching losses, achieving superior performance at a 1% compression rate on ADE20K and COCO‑Stuff.

By Wenjie Zheng, Haoji Hu, Jiali Lu, Xingze Zou, Jing Wang
Hugging Face Trending Papers
Sep 3

EraseSAE: Surgical Concept Erasure in Text-to-Video Diffusion Models via Sparse Autoencoders

EraseSAE introduces a surgical concept erasure method for text-to-video diffusion models, using sparse autoencoders to decompose activations into interpretable, monosemantic features. The framework employs a contrastive attribution mechanism to isolate concept-specific kernels and applies timestep-resolved masks during inference to remove target concepts while preserving unrelated content. Experiments show that EraseSAE achieves precise, robust concept removal with minimal quality loss, outperforming existing methods.

arXiv Computer Vision
Sep 2

Training-Free Inpainting Across Domains with a Frozen Text-to-Image Diffusion Model

The paper demonstrates that a frozen generic text‑to‑image diffusion model can perform conditional inpainting across three natural‑image domains without any inpainting‑specific training or dataset adaptation. The proposed Step‑PI method augments known‑region projection with boundary‑interior latent feedback, persistent PI state, and a predefined four‑field release schedule, improving all evaluated metrics over baseline training‑free approaches. Experiments on CelebA‑HQ, AFHQ, and Places2 show consistent gains, with Step‑PI outperforming LanPaint and PILOT on all five macro metrics.

By Zhenhuan Wang, Fengyi Yuan