arXiv Computer Vision

GPA-VGGT: Geometry-Preserving Acceleration of VGGT

GPA‑VGGT is a training‑free acceleration technique for the VGGT feed‑forward geometry model. It replaces VGGT’s global attention in early blocks with frame‑wise attention that uses a shared cross‑frame key/value set, and in later blocks it merges only keys and values while preserving queries and restoring attention mass. The method achieves speedups comparable to existing efficiency approaches while maintaining over 99% of VGGT’s pose accuracy on multi‑view geometry tasks.

arXiv Computer Vision
Oct 22

BlazeVGGT: 13x Faster VGGT at 2,000 Frames via Camera Token without Training

BlazeVGGT is a training‑free, plug‑and‑play module that speeds up the VGGT visual geometry model by sparsifying cross‑view attention. It selects a compact set of complementary views using a greedy determinantal point process, preserving dense per‑frame predictions while eliminating redundant computations. On 2,000‑frame sequences, BlazeVGGT achieves roughly 13× faster inference and improves Chamfer Distance from 0.41 to 0.32, demonstrating a strong accuracy–efficiency trade‑off for point‑cloud reconstruction and camera‑pose estimation.

By Shujun Yao, Junhui Lin, Congying Han, Tiande Guo, Ziwen Liu, Bonan Li
arXiv Computer Vision
6d ago

VGGT-$\Omega$

arXiv:2605.15195v2 Announce Type: replace Abstract: Recent feed-forward reconstruction models, such as VGGT, have proven competitive with traditional optimization-based reconstructors while also prov...

By Jianyuan Wang, Minghao Chen, Shangzhan Zhang, Nikita Karaev, Johannes Sch\"onberger, Patrick Labatut, Piotr Bojanowski, David Novotny, Andrea Vedaldi, Christian Rupprecht
arXiv Machine Learning
Oct 8

Hardware-aware Calibrated Clustered Attention for Efficient Visual Geometric Transformers

The paper introduces Hardware‑aware Calibrated Clustered Attention (BC attention) to speed up the global attention layers of the Visual Geometry Grounded Transformer (VGGT) used for 3D scene reconstruction. By clustering queries within hardware‑friendly neighborhood blocks and adding hashing hyperplane calibration plus threshold‑based error compensation, BC attention reduces computation and memory traffic, enabling it to handle long sequences with practical latency gains on GPUs. Experiments show that calibrated BC attention accelerates global attention by 2.10–2.63× and the entire backbone by 1.77–2.35×, with only a 1% loss in accuracy, and achieves up to 2.87× latency improvement with less than 5% performance drop.

By Weitian Wang, Shubham Rai, Cecilia De La Parra, Akash Kumar
arXiv AI
Sep 21

Think Locally, Refine Globally for Memory-Efficient 3D Reconstruction

LoG-VGGT is a memory‑efficient framework for long‑sequence 3D reconstruction that balances local temporal modeling with global camera consistency. It uses cross‑window attention in a small subset of transformer blocks to propagate information across adjacent temporal windows while keeping memory usage bounded. A global camera consistency refinement module further improves long‑horizon pose stability by enforcing scene‑level constraints through cross‑attention between camera and compact register tokens, leading to better depth accuracy and robust camera pose estimation on multiple benchmarks.

By Jingke Zhou, Chenhang Ma, Zhizhou Zhong, Mingkai Liu, Zhuang Zhou, Yicheng ji, Binghua Su, Bo Cai, Xianliang Huang
arXiv Computer Vision
Sep 3

Self-Geometry: GT-Free and Plug-and-Play Test-Time Adaptation for Geometrically Consistent 3D Vision Foundation Models

The paper introduces Self-Geometry, a plug‑and‑play test‑time adaptation framework that enforces explicit multi‑view geometric constraints on Vision Foundation Models (VFMs) using 2D pixel correspondences as pseudo ground truth. It combines Geometric Disentanglement Optimization—mixing Multi‑View and Epipolar Consistency losses with Gradient Disentanglement—to avoid gradient conflicts, a Frame Angular‑Neighbor sampler based on SO(3) geodesic distances to select informative views, and a Lightweight TTA module that adapts VFMs via LoRA. Experiments on six VFMs and four benchmarks (7Scenes, ETH3D, ScanNet++, HiRoom) show consistent improvements in pose and geometry estimation.

By Seokhyun Youn, Dahyeon Kye, Sung-Ho Bae, Jihyong Oh