arXiv Computer Vision

SpectralCache: Accelerating Diffusion-Based World Models via Spectral Feature Caching

SpectralCache is a training‑free framework that accelerates diffusion‑based world models by exploiting the stability of singular subspaces and predictable evolution of singular values across denoising steps. It reuses these stable subspaces and estimates low‑dimensional singular values via linear extrapolation, while also skipping expensive backbone evaluations through singular value scaling. Experiments on models such as HunyuanWorld‑Voyager‑13B show a 5.22× speed‑up with no loss in generation quality, outperforming existing caching methods.

Hugging Face Trending Papers
Jul 26

OmniCache: Multidimensional Hierarchical Feature Caching For Diffusion Models

High-resolution image and video diffusion models, including SD3, FLUX, and recent video diffusion transformers, have substantially improved generative quality but remain expensive at inference time because they repeatedly evaluate attention-heavy denoisers over many sampling steps. We address this inefficiency by exploiting redundancy in intermediate diffusion features rather than changing model weights or retraining.

arXiv Computer Vision
Aug 25

Pixel-Space Diffusion via Observation Operators

Pixel‑Space Diffusion via Observation Operators introduces a new framework for pixel‑space diffusion models that addresses a scale‑time mismatch in existing methods. By replacing fixed full‑image supervision with a time‑indexed observation trajectory that progresses from coarse structures to the full image, the model aligns supervision with the natural recovery order of image details. The approach employs Gaussian‑Lanczos operators and a GL‑CoDA decoder to refine features progressively, resulting in faster convergence and higher generation quality, achieving an FID of 1.52 on ImageNet‑256.

By Shaojie Guo, Lichen Ma, Haoyang Tong, Yu He, Zipeng Guo, Xiaoan Liu, Feng Yan, Yu Guo, Fei Wang, Junshi Huang, Yan Wang
arXiv Machine Learning
2d ago

CacheScope: Exact-Compute Allocation for Training-Free Diffusion Acceleration

CacheScope is a training‑free method that accelerates diffusion transformer inference by selectively replacing full denoising steps with cached approximations. It identifies high‑risk reuse steps online by normalizing probe‑output variation with input displacement, allowing the system to fall back to exact computation only when necessary. The approach achieves up to 3.57× speed‑up and reduces median LPIPS by up to 70.1% on several state‑of‑the‑art models without requiring additional training or offline scheduling.

By Qinhan Lyu, Jusheng Zhang, Zhixing Zhang, Hao Liu, Zijie Liang, Jin Jiang, Keze Wang