arXiv AI

Training-Free Acceleration of Multi-View 3D Transformers via Regime-Aware Attention Approximation

The paper introduces RAWATTA, a training‑free technique that accelerates multi‑view 3D transformers by approximating global attention in 8‑bit precision, selectively retaining 16‑bit precision only where necessary. It identifies three functional roles of transformer layers—averaging, matching, and anchoring—and applies different approximations accordingly, including a faster variant that further simplifies averaging and anchoring layers. On a 12 GB GPU with 50 images, RAWATTA speeds up VGGT while losing at most one point in pose accuracy, and both variants can handle 200 images, surpassing the released code’s memory limits.

arXiv Machine Learning
Oct 8

Hardware-aware Calibrated Clustered Attention for Efficient Visual Geometric Transformers

The paper introduces Hardware‑aware Calibrated Clustered Attention (BC attention) to speed up the global attention layers of the Visual Geometry Grounded Transformer (VGGT) used for 3D scene reconstruction. By clustering queries within hardware‑friendly neighborhood blocks and adding hashing hyperplane calibration plus threshold‑based error compensation, BC attention reduces computation and memory traffic, enabling it to handle long sequences with practical latency gains on GPUs. Experiments show that calibrated BC attention accelerates global attention by 2.10–2.63× and the entire backbone by 1.77–2.35×, with only a 1% loss in accuracy, and achieves up to 2.87× latency improvement with less than 5% performance drop.

By Weitian Wang, Shubham Rai, Cecilia De La Parra, Akash Kumar
arXiv Computer Vision
Oct 28

GPA-VGGT: Geometry-Preserving Acceleration of VGGT

GPA‑VGGT is a training‑free acceleration technique for the VGGT feed‑forward geometry model. It replaces VGGT’s global attention in early blocks with frame‑wise attention that uses a shared cross‑frame key/value set, and in later blocks it merges only keys and values while preserving queries and restoring attention mass. The method achieves speedups comparable to existing efficiency approaches while maintaining over 99% of VGGT’s pose accuracy on multi‑view geometry tasks.

By Muyeol Sung, Jangwon Kim, Jongwoo Lim
arXiv Computer Vision
Oct 27

VGGT-$\Omega$

arXiv:2605.15195v2 Announce Type: replace Abstract: Recent feed-forward reconstruction models, such as VGGT, have proven competitive with traditional optimization-based reconstructors while also prov...

By Jianyuan Wang, Minghao Chen, Shangzhan Zhang, Nikita Karaev, Johannes Sch\"onberger, Patrick Labatut, Piotr Bojanowski, David Novotny, Andrea Vedaldi, Christian Rupprecht
arXiv Machine Learning
Oct 12

Zebra3D: Efficient Hybrid Foundation Models For Scalable 3D Reconstruction

Zebra3D introduces a layerwise sparse‑linear hybrid attention framework that enhances the efficiency of pretrained 3D foundation models without requiring training from scratch. By assigning linear‑centered attention to tolerant early stages and tile‑sparse attention to sensitive middle‑to‑late stages, it preserves context through landmark summaries and enables training‑free conversion via closed‑form affine fitting. Across multiple backbones, Zebra3D achieves strong reconstruction and camera‑pose accuracy with high attention sparsity, delivering up to 7.1× speedups at 1,024 views and maintaining performance close to dense counterparts after optional post‑conversion training.

By Utkarsh Saxena, Ruijing Yang, Mehdi Rezagholizadeh, Akash Haridas, Vikram Appia, Emad Barsoum
arXiv Computer Vision
Nov 5

RegimeVGGT: Layer-Wise Spatially Preserving Redundancy Removal for Visual Geometry Grounded Transformer

RegimeVGGT introduces a layer‑wise compression strategy for the Visual Geometry Grounded Transformer (VGGT) that preserves spatial structure while reducing redundancy. By analyzing spectral, probing, and causal properties, the authors identify three functional regimes—shallow, middle, and deep layers—and apply a U‑shaped compression that protects salient tokens and cross‑frame spatial coverage. The method achieves a 6.7× speedup over the memory‑optimized VGGT* without any training, maintaining comparable reconstruction quality.

By Jinhao You (University of Pennsylvania), Shuo Lyu (University of Pennsylvania), Zhuohang Lyu (University of Pennsylvania), Tanxuan Li (University of Pennsylvania), Zibo Zhao (University of Pennsylvania), Jiaxiang Hu (University of California, Irvine), Kai Tang (Nanyang Technological University), Yichen Guo (Nanyang Technological University)
arXiv Computer Vision
Oct 22

BlazeVGGT: 13x Faster VGGT at 2,000 Frames via Camera Token without Training

BlazeVGGT is a training‑free, plug‑and‑play module that speeds up the VGGT visual geometry model by sparsifying cross‑view attention. It selects a compact set of complementary views using a greedy determinantal point process, preserving dense per‑frame predictions while eliminating redundant computations. On 2,000‑frame sequences, BlazeVGGT achieves roughly 13× faster inference and improves Chamfer Distance from 0.41 to 0.32, demonstrating a strong accuracy–efficiency trade‑off for point‑cloud reconstruction and camera‑pose estimation.

By Shujun Yao, Junhui Lin, Congying Han, Tiande Guo, Ziwen Liu, Bonan Li