arXiv AI

Parameterized Stripe Attention for Efficient Video Generation

arXiv Computer Vision
Oct 16

Sparse Attention for Video Generation Acceleration via Growing Sparsity and Reduced Search

The paper introduces Growing Sparsity and Reduced Search (GSRS), a training‑free framework that accelerates Diffusion Transformers for video generation by progressively increasing sparsity and reusing early attention blocks to limit search space. GSRS uses Top‑p selection for adaptive sparsity and a precise evaluation scheme that computes exact attention weights with negligible overhead. Experiments on HunyuanVideo and Wan 2.1 show 1.55×–2.21× speedups while preserving generation quality comparable to full attention.

By Yun Dai, Yuyun Chen, Jiarui Wen, Huiping Zhuang, Cen Chen, Ziqian Zeng
arXiv Computer Vision
Oct 9

iCATS: Fast Video Generation via Interaction-Aware Sparse Attention and Timestep-Adaptive Sparsity

iCATS introduces a training‑free sparse attention mechanism for Diffusion Transformers that accelerates video generation by reducing computations. It improves importance estimation by clustering query‑key dot‑product interactions and reformulates the objective as a quadratic form for low‑cost computation. The method also adapts sparsity dynamically across denoising timesteps using an SNR‑guided schedule and employs a tail‑merging strategy to enhance GPU kernel utilization, achieving significant speedups while maintaining high PSNR scores.

By Chengfeng Han, Baole Ai, Xianlu Bian, Jie Yao, Zilong Huang, Ang Wang, Dandan Ding
arXiv AI
3d ago

VMonarch: Efficient Video Diffusion Transformers with Structured Attention

VMonarch introduces a structured Monarch matrix to replace the quadratic attention in Video Diffusion Transformers, enabling sub‑quadratic computation. The method captures intra‑ and inter‑frame correlations, mitigates instability artifacts, and integrates an online entropy algorithm with FlashAttention for efficient updates. Experiments show comparable or better generation quality, a 17.5× reduction in FLOPs, and over 5× speedup for long videos, outperforming state‑of‑the‑art sparse attention at 90% sparsity.

By Cheng Liang, Haoxian Chen, Liang Hou, Qi Fan, Gangshan Wu, Xin Tao, Limin Wang
arXiv Computer Vision
Oct 21

PISA: Piecewise Sparse Attention Is Wiser for Efficient Diffusion Transformers

PISA introduces a training‑free Piecewise Sparse Attention mechanism that preserves full attention span while reducing complexity. It keeps exact computation for critical blocks and approximates non‑critical ones using block‑wise Taylor expansion, avoiding the quality loss seen in conventional sparse attention. Experiments show significant speedups—up to 2.57× on Hunyuan‑Video—while maintaining or improving visual quality across video and image generation tasks.

By Haopeng Li, Shitong Shao, Wenliang Zhong, Zikai Zhou, Lichen Bai, Hui Xiong, Zeke Xie
arXiv Computer Vision
Nov 5

DecoupAttn: Decoupled Sparse Attention for Training-Free Acceleration of Video Diffusion

DecoupAttn introduces a decoupled sparse attention mechanism for video diffusion transformers, separating key block computation from error compensation. It uses a distortion‑budget objective to allocate exact attention across timesteps, layers, and heads, and a reassign cache to refresh key assignments while keeping budgeted blocks fixed. The method is training‑free, requiring only a few calibration clips to compile an offline plan, after which inference runs with standard block‑sparse kernels and a fused compensation kernel.

By Yanjin Li, Bingbing Qiu, Qiang Huang, Rui Qian, Yanfeng Li, Jian Wang, Xiaoying Tang, Mingda Zhang
arXiv Machine Learning
Jul 2

Mixture of Distributions Matters: Dynamic Sparse Attention for Efficient Video Diffusion Transformers

arXiv:2601. 11641v3 Announce Type: replace-cross Abstract: While Diffusion Transformers (DiTs) have achieved notable progress in video generation, this long-sequence generation task remains constrained by the quadratic complexity inherent to self-attention mechanisms, creating significant barriers to practical deployment.

By Yuxi Liu, Yipeng Hu, Zekun Zhang, Kunze Jiang, Kun Yuan
arXiv Computer Vision
Sep 22

SparkDiffusion: Mitigating the High-Sparsity Trap --- A Unified Framework for up to $265\times$ Single-GPU Acceleration of Visual Generation

arXiv:2609.23153v1 Announce Type: new Abstract: Video diffusion transformers are expensive because attention dominates long spatiotemporal token sequences. We identify the \emph{high-sparsity trap}:...

By Yuxi Liu, Haoyu Li, Zekun Zhang, Tengxu Sun, Yixiang Cai, Jiayong Li, Yifei Xia, Tianle Liu, Baole Ai, Ang Wang, Jiamang Wang, Lin Qu, Kai Zhang, Kun Yuan, Bin Cui