arXiv Computer Vision

Decompose the Distillation: Interpretable Single-Pass Guidance for Diffusion Models

arXiv Computer Vision
Sep 30

LongLive-Plug: Once-for-All Distillation for Video Generation

LongLive‑Plug is a once‑for‑all distillation framework that learns reusable LoRA adapters on a base video diffusion model, enabling training‑free, plug‑and‑play deployment to a wide range of downstream models. These adapters provide single‑pass classifier‑free guidance, few‑step sampling, and long‑context error correction for autoregressive generation, and remain effective even when downstream models add conditioning branches or expand output channels. The authors demonstrate that the approach works on 54 downstream models across three backbone families and eight task categories, including world modeling, robotics, editing, and multimodal generation.

By Shuai Yang, Luozhou Wang, Wei Huang, ZhiFei Chen, Bohan Zhang, Xiao Fu, Qianli Ma, Chen-Hsuan Lin, Weian Mao, Bryan Chu, Song Han, Yukang Chen
arXiv Machine Learning
Jun 30

Momentum Guidance: Plug-and-Play Guidance for Flow Models

arXiv:2602. 20360v2 Announce Type: replace Abstract: Flow-based generative methods offer a simple and effective framework for high-fidelity generation, yet pretrained flow models are rarely used in their vanilla conditional form: in image generation, samples without guidance often appear diffuse and lack fine-grained detail.

By Runlong Liao, Jian Yu, Baiyu Su, Chi Zhang, Lizhang Chen, Qiang Liu
arXiv Computer Vision
Oct 23

TrajCFG: Token-Wise Classifier-Free Guidance via Denoising Trajectory Feedback

TrajCFG introduces a training‑free, token‑wise adaptation of classifier‑free guidance for flow‑matching models, leveraging historical changes in guided velocity direction to assign bounded scales. By mapping directional feedback to stronger guidance for larger changes and weaker guidance for consistent directions, it fuses adjacent‑step and interval‑normalized longer‑span signals without extra model evaluations. Experiments across text‑to‑video, image‑to‑video, text‑to‑audio‑video, text‑to‑image, and image‑to‑3D tasks demonstrate consistent improvements over base samplers, notably raising VBench Total scores by 0.30‑0.75 points on three backbones for text‑to‑video generation.

By Jingyu Liu, Hao Jiang, Yikang Ding, Huafeng Shi, Xu Yang, Xiaoqiang Liu, Guoxin Zhang, Pengfei Wan, Kun Gai
arXiv Machine Learning
Oct 7

Global Transport Couplings for Classifier-Free Guided Flows

The paper introduces Global Transport (GT), a class‑agnostic optimal‑transport coupling that can be computed without class labels. GT associates different conditions with distinct regions of the source noise, which degrades performance when used without guidance but consistently improves generation when combined with classifier‑free guidance across various domains, model scales, and sampling budgets. The authors argue that coupling design should be evaluated under guided flow conditions rather than unguided generation, and demonstrate GT’s benefits on both discrete class‑conditioned and continuous text‑conditioned image generation.

By Katarina Petrovi\'c, Zander W. Blasingame, Danyal Rehman, \.Ismail \.Ilkan Ceylan, Michael Bronstein, Stephen Y. Zhang, Lazar Atanackovic, Alexander Tong
arXiv AI
Sep 25

Accelerating Video Diffusion via Training-Free Trajectory Routing

The paper introduces TRACK, a training‑free trajectory routing method that accelerates video diffusion by selectively switching between large and small models during denoising steps. A calibration process generates a disagreement score map, guiding the selection of the appropriate model at each step to maintain quality while reducing computational cost. Experiments on Wan 2.1, Cosmos 3, TurboDiffusion, and FastVideo show speedups ranging from 1.95× to 2.73× with comparable quality and diversity.

By Mustafa Munir, Huy Vu, Shreyas Misra, Rohit Jena, Sajad Norouzi, Ali Taghibakhshi, Anis Ahmad, Anjul Patney, Pavlo Molchanov, Nima Tajbakhsh
arXiv Computer Vision
Oct 12

A Lightweight Velocity Correction Framework for Improving Instruction Following in Few-Step Text-to-Image Generation

The paper introduces a lightweight correction framework that improves instruction following in few-step text-to-image generators without altering the generator’s parameters or increasing forward-pass count. The framework adds a small corrector module (<20 M parameters) that learns residual velocity adjustments at selected sampling steps, using On‑Trajectory Flow‑Bridge Supervision to target the actual states reached during corrected generation. Experiments show a +17.60‑point NetWin over a frozen baseline with only a 0.84% increase in end‑to‑end latency.

By Yating Gao, Zhenlong Zhu, Wen Zihao, Lenan Zhang, Jiexiong Wang, Yang Yang, Guanjun Jiang, Yixiong Zou, Takuya Maekawa