arXiv Computer Vision By Yusung Choi

Diffusion Trajectory Modeling for Semantic Correspondence

Read the original on arXiv Computer Vision →

Diffusion Trajectory Modeling (DTM) treats the evolving feature maps of diffusion models as temporally structured trajectories rather than static snapshots. By interpreting each spatial patch’s progression across multiple timesteps as a trajectory, DTM captures semantic correspondence cues that prior methods miss. Experiments on SPair-71k, SPair-U, and AP-10K demonstrate that DTM achieves strong performance, highlighting the semantic value embedded in the diffusion process’s temporal axis.

Machine-generated by The Flow from the publisher's headline and feed description — not written or checked by a human. The full article lives at arXiv Computer Vision.

arXiv Computer Vision
Aug 26

Representation Learning in Diffusion and Flow-based Model: An Application Aspect

The article surveys how diffusion and flow-based generative models learn rich visual representations and how these representations can be used to improve generation and other perception tasks. It introduces a three-tier framework that categorizes work into improving generative quality via representation learning, extracting representations for perception, and developing unified applications. The survey covers downstream tasks such as image classification, dense prediction, instance-level perception, and annotation-scarce scenarios, offering a taxonomy and highlighting future research directions.

By Yanchen Xu, Sida Huang, Zhenyu Gu, Ruishu Zhu, Yilan Gao, Hongyuan Zhang
arXiv AI
Jul 8

Few Channels Draw The Whole Picture: Revealing Massive Activations in Diffusion Transformers

arXiv:2605. 13974v2 Announce Type: replace-cross Abstract: Diffusion Transformers (DiTs) and related flow-based architectures are now among the strongest text-to-image generators, yet the internal mechanisms through which prompts shape image semantics remain poorly understood.

By Evelyn Turri, Davide Bucciarelli, Sara Sarto, Lorenzo Baraldi, Marcella Cornia