arXiv Machine Learning

OnlineCache: Learning Dynamic Caching Policies with Error Correction for Efficient Diffusion Inference

arXiv:2607. 29398v1 Announce Type: new Abstract: Diffusion models have revolutionized generative tasks but incur high latency due to iterative denoising.