arXiv AI By Muhammed Izzet Sezer, Sevval Belkis Dikkaya

Training-Free Acceleration of Multi-View 3D Transformers via Regime-Aware Attention Approximation

Read the original on arXiv AI →

The paper introduces RAWATTA, a training‑free technique that accelerates multi‑view 3D transformers by approximating global attention in 8‑bit precision, selectively retaining 16‑bit precision only where necessary. It identifies three functional roles of transformer layers—averaging, matching, and anchoring—and applies different approximations accordingly, including a faster variant that further simplifies averaging and anchoring layers. On a 12 GB GPU with 50 images, RAWATTA speeds up VGGT while losing at most one point in pose accuracy, and both variants can handle 200 images, surpassing the released code’s memory limits.

Machine-generated by The Flow from the publisher's headline and feed description — not written or checked by a human. The full article lives at arXiv AI.

arXiv Machine Learning
Oct 8

Hardware-aware Calibrated Clustered Attention for Efficient Visual Geometric Transformers

The paper introduces Hardware‑aware Calibrated Clustered Attention (BC attention) to speed up the global attention layers of the Visual Geometry Grounded Transformer (VGGT) used for 3D scene reconstruction. By clustering queries within hardware‑friendly neighborhood blocks and adding hashing hyperplane calibration plus threshold‑based error compensation, BC attention reduces computation and memory traffic, enabling it to handle long sequences with practical latency gains on GPUs. Experiments show that calibrated BC attention accelerates global attention by 2.10–2.63× and the entire backbone by 1.77–2.35×, with only a 1% loss in accuracy, and achieves up to 2.87× latency improvement with less than 5% performance drop.

By Weitian Wang, Shubham Rai, Cecilia De La Parra, Akash Kumar
arXiv Computer Vision
Oct 28

GPA-VGGT: Geometry-Preserving Acceleration of VGGT

GPA‑VGGT is a training‑free acceleration technique for the VGGT feed‑forward geometry model. It replaces VGGT’s global attention in early blocks with frame‑wise attention that uses a shared cross‑frame key/value set, and in later blocks it merges only keys and values while preserving queries and restoring attention mass. The method achieves speedups comparable to existing efficiency approaches while maintaining over 99% of VGGT’s pose accuracy on multi‑view geometry tasks.

By Muyeol Sung, Jangwon Kim, Jongwoo Lim
arXiv Computer Vision
Oct 27

VGGT-$\Omega$

arXiv:2605.15195v2 Announce Type: replace Abstract: Recent feed-forward reconstruction models, such as VGGT, have proven competitive with traditional optimization-based reconstructors while also prov...

By Jianyuan Wang, Minghao Chen, Shangzhan Zhang, Nikita Karaev, Johannes Sch\"onberger, Patrick Labatut, Piotr Bojanowski, David Novotny, Andrea Vedaldi, Christian Rupprecht