← Back to all news
arXiv Machine Learning By Weitian Wang, Shubham Rai, Cecilia De La Parra, Akash Kumar

Hardware-aware Calibrated Clustered Attention for Efficient Visual Geometric Transformers

Read the original on arXiv Machine Learning →

The paper introduces Hardware‑aware Calibrated Clustered Attention (BC attention) to speed up the global attention layers of the Visual Geometry Grounded Transformer (VGGT) used for 3D scene reconstruction. By clustering queries within hardware‑friendly neighborhood blocks and adding hashing hyperplane calibration plus threshold‑based error compensation, BC attention reduces computation and memory traffic, enabling it to handle long sequences with practical latency gains on GPUs. Experiments show that calibrated BC attention accelerates global attention by 2.10–2.63× and the entire backbone by 1.77–2.35×, with only a 1% loss in accuracy, and achieves up to 2.87× latency improvement with less than 5% performance drop.

Machine-generated by The Flow from the publisher's headline and feed description — not written or checked by a human. The full article lives at arXiv Machine Learning.

Related stories

arXiv Machine Learning
Aug 28

ClusterAttention: A training-free speedup of bidirectional attention

ClusterAttention is a training‑free technique that speeds up bidirectional attention by recursively clustering keys and queries into fixed‑size, power‑of‑two blocks, enabling block‑sparse attention to match dense attention latency on GPUs. The method derives error bounds for sparse attention, showing tighter clusters can reduce error when compensated via centroids, and demonstrates significant speedups—up to six‑fold on large tabular data and 1.8× on video generation—while preserving over 99% of dense accuracy.

By Kasper Nordenram, Amelie Dittmann
diffusion
More like this →
arXiv AI
Jun 2

STaR-KV: Spatio-Temporal Adaptive Re-weighting for KV Cache Compression in GUI Vision-Language Models

arXiv:2606. 01790v1 Announce Type: cross Abstract: Vision-language-model-based graphical user interface (GUI) agents have shown broad automation capabilities, yet deployment is bottlenecked by a key-value (KV) cache that grows linearly with interaction steps.

By Yuhang Han, Wenzheng Yang, Yujie Chen, Xiangqi Jin, Yaojie Zhang, Siteng Huang, Linfeng Zhang
llmsagentsefficiencymultimodalbenchmarks
More like this →
arXiv Machine Learning
Oct 12

Zebra3D: Efficient Hybrid Foundation Models For Scalable 3D Reconstruction

Zebra3D introduces a layerwise sparse‑linear hybrid attention framework that enhances the efficiency of pretrained 3D foundation models without requiring training from scratch. By assigning linear‑centered attention to tolerant early stages and tile‑sparse attention to sensitive middle‑to‑late stages, it preserves context through landmark summaries and enables training‑free conversion via closed‑form affine fitting. Across multiple backbones, Zebra3D achieves strong reconstruction and camera‑pose accuracy with high attention sparsity, delivering up to 7.1× speedups at 1,024 views and maintaining performance close to dense counterparts after optional post‑conversion training.

By Utkarsh Saxena, Ruijing Yang, Mehdi Rezagholizadeh, Akash Haridas, Vikram Appia, Emad Barsoum
fine-tuningefficiency
More like this →