Does VGGT Know What It Does Not Know?
Read the original on arXiv Computer Vision →The Flow has not summarised this story yet — read it at arXiv Computer Vision.
The Flow has not summarised this story yet — read it at arXiv Computer Vision.
The study investigates which layers of feed‑forward geometry models—specifically VGGT, π³, and VGGT‑Ω—are essential for preserving camera poses and dense 3D structure. By pruning 3,018 configurations and evaluating seven metrics across indoor and outdoor datasets, the authors identify two redundancy regions (early and late) and show that combined deletions degrade performance additively, enabling more efficient pruning. They also demonstrate that CKA can serve as a cheaper proxy for interval degradation, and that closed‑form linear calibration can recover accuracy without retraining, reducing aggregator parameters by up to 44% while maintaining comparable performance.
arXiv:2610.07883v1 Announce Type: new Abstract: A correctly reconstructed distant point appears uncertain even when a frozen 3D model processes equivalent inputs because its output frame rotates frac...
The paper argues that internal self-consistency checks cannot guarantee the accuracy of photogrammetric reconstructions, a limitation that is structural rather than a tuning issue. It introduces a track‑leakage‑free hold‑out protocol that withholds a deterministic subset of images and tests each against only 3D points supported by at least two retained images, ensuring no view is evaluated against the structure it helped create. Experiments on diverse datasets show that while the protocol is well‑posed, it saturates at a confidence score of 1.00 and fails to detect coherent distortion, missing large errors that can reach over 100 m. whyItMatters":"The study highlights that hold‑out self‑validation scores, increasingly used as quality evidence for metric deliverables, may be misleading and cannot replace external survey validation."
arXiv:2609.09507v1 Announce Type: new Abstract: Learned image matching has experienced significant progress in recent years, culminating in robust and accurate matchers such as RoMa, whose robustness...
GeoCond is a lightweight reliability adapter that enhances frozen feed‑forward 3D reconstruction backbones by reading their predicted geometry to produce pose‑level uncertainty and a refinement gate. It can be trained using permutation‑orbit variance, ground‑truth pose error, or cycle residuals from unlabeled pose graphs, and at inference requires only a single backbone pass plus a small MLP. On the VGGT backbone, GeoCond reduces out‑of‑distribution AUSE from 0.32 to 0.20, transfers zero‑shot to outdoor extreme‑view scenes, and prevents collapse from uniform bundle adjustment, while also enabling gated refinement, pose‑graph weighting, calibration, curation, and capture decisions.
Feed-forward 3D foundation models such as VGGT predict cameras, depth, and point maps in a single pass, but can fail silently under low overlap, low parallax, and extreme relative rotation. Stratified...