arXiv Computer Vision

A Calibration Audit of Confidence in Feed-Forward 3D Reconstruction Models

The paper audits the confidence outputs of seven feed‑forward 3D reconstruction backbones across 13 datasets, evaluating four properties: error ranking, average error‑to‑uncertainty ratio, slope of this ratio, and coverage of the implied error distribution. While confidence ranks errors well, the decoded uncertainty is consistently too small—off by at least 2.4× on median cases—and worsens with higher confidence. A post‑hoc power‑law fit per backbone‑dataset pair improves all four metrics at the dataset level, reducing the median error by 1.35×, but fails to correct coverage for many held‑out scenes, indicating the models lack the correct error scale and distribution shape.

arXiv Computer Vision
Sep 4

Hold-Out Self-Validation Cannot Certify Photogrammetric Accuracy: Saturation and Blindness to Coherent Distortion

The paper argues that internal self-consistency checks cannot guarantee the accuracy of photogrammetric reconstructions, a limitation that is structural rather than a tuning issue. It introduces a track‑leakage‑free hold‑out protocol that withholds a deterministic subset of images and tests each against only 3D points supported by at least two retained images, ensuring no view is evaluated against the structure it helped create. Experiments on diverse datasets show that while the protocol is well‑posed, it saturates at a confidence score of 1.00 and fails to detect coherent distortion, missing large errors that can reach over 100 m. whyItMatters":"The study highlights that hold‑out self‑validation scores, increasingly used as quality evidence for metric deliverables, may be misleading and cannot replace external survey validation."

By Behnam Asadi
arXiv AI
Oct 16

Are You Sure Your LLM Is Sure? Repairing and Auditing Confidence

The paper introduces RADAR, a framework for repairing and auditing confidence scores in large language models (LLMs). It separates confidence repair from deployment decisions and from error auditing, proposing Probe‑Anchored Isotonic Calibration (PAIC) for monotone mapping and a prompt‑clustered kernel test for detecting residual errors. Experiments across checkpoints and benchmarks show that richer predictors can improve confidence estimation, but projecting back to a scalar score can lose gains, and lower prediction risk does not always lead to better review decisions.

By Arijit Dey, Bhartendu Kumar, Ramya Hebbalaguppe, Khuushi Maheshwari
arXiv Computer Vision
Sep 17

GeoCond: A Conditioning-Aware Reliability Adapter for Feed-Forward 3D Reconstruction

GeoCond is a lightweight reliability adapter that enhances frozen feed‑forward 3D reconstruction backbones by reading their predicted geometry to produce pose‑level uncertainty and a refinement gate. It can be trained using permutation‑orbit variance, ground‑truth pose error, or cycle residuals from unlabeled pose graphs, and at inference requires only a single backbone pass plus a small MLP. On the VGGT backbone, GeoCond reduces out‑of‑distribution AUSE from 0.32 to 0.20, transfers zero‑shot to outdoor extreme‑view scenes, and prevents collapse from uniform bundle adjustment, while also enabling gated refinement, pose‑graph weighting, calibration, curation, and capture decisions.

By David Ahmedt-Aristizabal, Mohammad Ali Armin, Russell Tsuchida, Lars Petersson