arXiv Computer Vision

Feature Space Analysis by Guided Diffusion Model

The paper introduces a decoder that generates images whose features closely match a user-specified feature, enabling detailed analysis of a vision-related deep neural network’s feature space. Implemented as a guided diffusion model, it steers a pre-trained diffusion model to minimize the Euclidean distance between the feature of a clean image and the target feature at each generation step. The method is training‑free, works on a single COTS GPU, and has been validated on CLIP’s image encoder and ResNet‑50, showing high feature‑matching accuracy and practical feasibility.

arXiv AI
Sep 2

V-Co: A Closer Look at Visual Representation Alignment via Co-Denoising

V-Co investigates visual co-denoising for pixel-space diffusion models, using a unified JiT-based framework to isolate key design choices. The study identifies two essential components: a dual-stream architecture with flexible cross-stream interaction and a perceptual-drifting hybrid loss combined with RMS-based feature rescaling for stronger semantic supervision. Experiments on ImageNet-256 demonstrate that V-Co surpasses baseline pixel-space diffusion and strong prior pixel-diffusion methods at comparable model sizes while requiring fewer training epochs.

By Han Lin, Xichen Pan, Zun Wang, Yue Zhang, Chu Wang, Jaemin Cho, Mohit Bansal