arXiv Computer Vision By Ruxi Gu, Zilei Wang, Wei Wang

TACO: Trajectory-Aware Curvature Observation for Memorization Localization and Mitigation in Diffusion Models

Read the original on arXiv Computer Vision →

TACO (Trajectory-Aware Curvature Observation) is a framework designed to detect and mitigate memorized content in text-to-image diffusion models. It aggregates curvature responses along the late denoising trajectory and uses latent-guided spatial refinement to produce a memorization map that both localizes and guides targeted mitigation. Experiments show TACO outperforms existing localization methods and improves the balance between memorization suppression, semantic alignment, and perceptual quality.

Machine-generated by The Flow from the publisher's headline and feed description — not written or checked by a human. The full article lives at arXiv Computer Vision.

arXiv Machine Learning
Oct 9

Beyond Sample Copying: Structural Memorization in Diffusion Models

The paper investigates why diffusion models, despite their practical success, can fully memorize training data when optimal. It shows that as training proceeds, the denoising objective causes overfitting at intermediate noise levels, creating a gap between validation and training performance. In a 2D toy model, this gap arises from the interplay between model error and the data distribution’s support density, leading to a smooth, generalizing flow field rather than exact recall of training points. The study also reveals that predictions from intermediate inference states become increasingly similar to training data in feature space, even as overall similarity to validation data remains unchanged.

By Tim Kaiser, Markus Kollmann