arXiv:2610.29441v1 Announce Type: new
Abstract: Full 3D attention is costly in video Diffusion Transformers. Block-sparse attention reduces this cost by computing only selected attention blocks. Howe...
By Tianze Xia, Xiaoling Zhou, Ruya Lan, Yiqiao Liao, Chengru Song, Shiming Xiang
DecoupAttn introduces a decoupled sparse attention mechanism for video diffusion transformers, separating key block computation from error compensation. It uses a distortion‑budget objective to allocate exact attention across timesteps, layers, and heads, and a reassign cache to refresh key assignments while keeping budgeted blocks fixed. The method is training‑free, requiring only a few calibration clips to compile an offline plan, after which inference runs with standard block‑sparse kernels and a fused compensation kernel.
By Yanjin Li, Bingbing Qiu, Qiang Huang, Rui Qian, Yanfeng Li, Jian Wang, Xiaoying Tang, Mingda Zhang
Sparse attention accelerates few-step video diffusion transformers by computing a few key blocks exactly and compensating for the rest. However, existing sparse attention still faces key challenges, i...
Diffusion Transformers (DiTs) incur quadratic self-attention cost over spatiotemporal tokens. Existing training-free sparse attention methods often construct sparse masks from block-level or cluster-level proxy scores, which can obscure fine-grained differences among keys and miss high contribution keys under aggressive sparsity.
arXiv:2609.37001v1 Announce Type: cross
Abstract: Diffusion Transformers (DiTs) enable high-quality video generation but suffer from substantial inference latency, primarily attributable to the compu...
By Xingyu Jia, Baole Ai, Ang Wang, Kang Zhao, Yong Li
arXiv:2609.38978v1 Announce Type: new
Abstract: Diffusion Transformers (DiTs) have become a dominant architecture for video generation, but their efficiency is limited by the quadratic complexity of...
By Yun Dai, Jiarui Wen, Huiping Zhuang, Cen Chen, Ziqian Zeng