arXiv Machine Learning

Koopman Observers for Diffusion Acceleration: Correcting Feature Forecasts with Shallow Measurements

arXiv Machine Learning
2d ago

CacheScope: Exact-Compute Allocation for Training-Free Diffusion Acceleration

CacheScope is a training‑free method that accelerates diffusion transformer inference by selectively replacing full denoising steps with cached approximations. It identifies high‑risk reuse steps online by normalizing probe‑output variation with input displacement, allowing the system to fall back to exact computation only when necessary. The approach achieves up to 3.57× speed‑up and reduces median LPIPS by up to 70.1% on several state‑of‑the‑art models without requiring additional training or offline scheduling.

By Qinhan Lyu, Jusheng Zhang, Zhixing Zhang, Hao Liu, Zijie Liang, Jin Jiang, Keze Wang
arXiv AI
Sep 25

Accelerating Video Diffusion via Training-Free Trajectory Routing

The paper introduces TRACK, a training‑free trajectory routing method that accelerates video diffusion by selectively switching between large and small models during denoising steps. A calibration process generates a disagreement score map, guiding the selection of the appropriate model at each step to maintain quality while reducing computational cost. Experiments on Wan 2.1, Cosmos 3, TurboDiffusion, and FastVideo show speedups ranging from 1.95× to 2.73× with comparable quality and diversity.

By Mustafa Munir, Huy Vu, Shreyas Misra, Rohit Jena, Sajad Norouzi, Ali Taghibakhshi, Anis Ahmad, Anjul Patney, Pavlo Molchanov, Nima Tajbakhsh
Hugging Face Trending Papers
Sep 24

Accelerating Video Diffusion via Training-Free Trajectory Routing

Accelerating Video Diffusion via Training-Free Trajectory Routing (TRACK) introduces a heterogeneous denoising strategy that switches between large and small diffusion models at selected steps, determined by a calibration process that measures disagreement between model predictions. By routing quality-sensitive steps to the large model and low-disagreement steps to the small model, TRACK achieves significant speedups—up to 2.73×—across several video diffusion benchmarks while maintaining comparable quality and diversity. The method requires no retraining, architectural changes, or online dual-model evaluation, making it a practical acceleration paradigm for video diffusion.