arXiv AI By Andrei Jarca, Vlad Hondru, Florinel-Alin Croitoru, Radu Tudor Ionescu

EigDiff: Eigensample Diffusion - or how to significantly reduce training dataset size with marginal performance variation?

Read the original on arXiv AI →

EigDiff proposes using eigensamples to train diffusion models on much smaller datasets while maintaining performance. By computing latent eigenvectors via PCA in a pre‑trained CLIP space, the method selects a representative training set that includes exemplars close to these eigenvectors and diverse images. Experiments show that EigDiff can reduce training data size by up to 14× and accelerate subset selection by up to 1607× with only marginal performance loss.

Machine-generated by The Flow from the publisher's headline and feed description — not written or checked by a human. The full article lives at arXiv AI.

arXiv Computer Vision
Oct 16

Spectrum Matching: a Unified Perspective for Superior Diffusability in Latent Diffusion

The paper investigates how variational autoencoders (VAEs) can be made more learnable in latent diffusion by analyzing diffusability through spectral properties. It introduces the Spectrum Matching Hypothesis, which posits that latents with better diffusability should have a flattened power‑law power spectral density (Encoding Spectrum Matching) and preserve frequency‑to‑frequency semantic correspondence via the decoder (Decoding Spectrum Matching). The authors implement these ideas by matching PSDs between images and latents and applying shared spectral masking, demonstrating improved diffusion generation on CelebA and ImageNet and extending the approach to representation alignment with a DoG‑based method.

By Mang Ning, Mingxiao Li, Le Zhang, Lanmiao Liu, Matthew B. Blaschko, Albert Ali Salah, Itir Onal Ertugrul