arXiv:2609.23733v1 Announce Type: new
Abstract: Feed-forward visual geometry models such as the Visual Geometry Grounded Transformer (VGGT) have recently enabled direct 3D reconstruction from multi-v...
By Abteen Arab, Guile Wu, Chengjie Huang, Dongfeng Bai
The paper introduces Hardware‑aware Calibrated Clustered Attention (BC attention) to speed up the global attention layers of the Visual Geometry Grounded Transformer (VGGT) used for 3D scene reconstruction. By clustering queries within hardware‑friendly neighborhood blocks and adding hashing hyperplane calibration plus threshold‑based error compensation, BC attention reduces computation and memory traffic, enabling it to handle long sequences with practical latency gains on GPUs. Experiments show that calibrated BC attention accelerates global attention by 2.10–2.63× and the entire backbone by 1.77–2.35×, with only a 1% loss in accuracy, and achieves up to 2.87× latency improvement with less than 5% performance drop.
By Weitian Wang, Shubham Rai, Cecilia De La Parra, Akash Kumar
GPA‑VGGT is a training‑free acceleration technique for the VGGT feed‑forward geometry model. It replaces VGGT’s global attention in early blocks with frame‑wise attention that uses a shared cross‑frame key/value set, and in later blocks it merges only keys and values while preserving queries and restoring attention mass. The method achieves speedups comparable to existing efficiency approaches while maintaining over 99% of VGGT’s pose accuracy on multi‑view geometry tasks.
By Muyeol Sung, Jangwon Kim, Jongwoo Lim
arXiv:2605.15195v2 Announce Type: replace
Abstract: Recent feed-forward reconstruction models, such as VGGT, have proven competitive with traditional optimization-based reconstructors while also prov...
By Jianyuan Wang, Minghao Chen, Shangzhan Zhang, Nikita Karaev, Johannes Sch\"onberger, Patrick Labatut, Piotr Bojanowski, David Novotny, Andrea Vedaldi, Christian Rupprecht
arXiv:2611.18099v1 Announce Type: cross
Abstract: Feed-forward multi-view transformers such as VGGT recover the cameras and geometry of a video in one pass, but the cost of their cross-frame attentio...
By Hongsen Cao, Shanxin Yuan, Mona Jaber, Ahmed Sayed
arXiv:2607. 03612v1 Announce Type: cross Abstract: Feed-forward 3D reconstruction (F3R) transformers have recently achieved remarkable success.
By Jianing Deng, Yuanzhe Li, Jialu Wang, Song Wang, Tianlong Chen, Huanrui Yang, Jingtong Hu
Zebra3D introduces a layerwise sparse‑linear hybrid attention framework that enhances the efficiency of pretrained 3D foundation models without requiring training from scratch. By assigning linear‑centered attention to tolerant early stages and tile‑sparse attention to sensitive middle‑to‑late stages, it preserves context through landmark summaries and enables training‑free conversion via closed‑form affine fitting. Across multiple backbones, Zebra3D achieves strong reconstruction and camera‑pose accuracy with high attention sparsity, delivering up to 7.1× speedups at 1,024 views and maintaining performance close to dense counterparts after optional post‑conversion training.
By Utkarsh Saxena, Ruijing Yang, Mehdi Rezagholizadeh, Akash Haridas, Vikram Appia, Emad Barsoum
arXiv:2605.12491v2 Announce Type: replace
Abstract: Vision Transformers (ViTs) learn rich visual-semantic representations through all-to-all self-attention among patch tokens. However, this design im...
By Alan Z. Song, Yinjie Chen, Mu Nan, Deva Ramanan, Michael J. Tarr, Andrew F. Luo
arXiv:2605.08371v2 Announce Type: replace
Abstract: Multi-view geometry transformers are feed-forward 3D foundation models that jointly predict depth maps, point maps, and camera poses for N images i...
By Haotang Li, Zhenyu Qi, Shaohan Henry Wang, Kebin Peng, Zi Wang, Qing Guo, Sen He, Huanrui Yang
RegimeVGGT introduces a layer‑wise compression strategy for the Visual Geometry Grounded Transformer (VGGT) that preserves spatial structure while reducing redundancy. By analyzing spectral, probing, and causal properties, the authors identify three functional regimes—shallow, middle, and deep layers—and apply a U‑shaped compression that protects salient tokens and cross‑frame spatial coverage. The method achieves a 6.7× speedup over the memory‑optimized VGGT* without any training, maintaining comparable reconstruction quality.
By Jinhao You (University of Pennsylvania), Shuo Lyu (University of Pennsylvania), Zhuohang Lyu (University of Pennsylvania), Tanxuan Li (University of Pennsylvania), Zibo Zhao (University of Pennsylvania), Jiaxiang Hu (University of California, Irvine), Kai Tang (Nanyang Technological University), Yichen Guo (Nanyang Technological University)
BlazeVGGT is a training‑free, plug‑and‑play module that speeds up the VGGT visual geometry model by sparsifying cross‑view attention. It selects a compact set of complementary views using a greedy determinantal point process, preserving dense per‑frame predictions while eliminating redundant computations. On 2,000‑frame sequences, BlazeVGGT achieves roughly 13× faster inference and improves Chamfer Distance from 0.41 to 0.32, demonstrating a strong accuracy–efficiency trade‑off for point‑cloud reconstruction and camera‑pose estimation.
By Shujun Yao, Junhui Lin, Congying Han, Tiande Guo, Ziwen Liu, Bonan Li
arXiv:2610.15855v1 Announce Type: new
Abstract: We study how to detect and mitigate visual attention sinks in vision-language models (VLMs). Visual attention sinks are image tokens that absorb a larg...
By Dengjia Zhang, Alexander Martin, Pengyu Yan, Xihan Sun, Jiaqi Li, Benjamin Van Durme, Andrew Yates, Reno Kriz, William Walden