How Murky Before a VLM Knows It Cannot See? Accuracy, Confidence and Abstention on a Physical Visibility Axis
Read the original on arXiv Machine Learning →The Flow has not summarised this story yet — read it at arXiv Machine Learning.
The Flow has not summarised this story yet — read it at arXiv Machine Learning.
arXiv:2607. 22034v1 Announce Type: cross Abstract: Vision-language models (VLMs) are increasingly deployed on consumer hardware where input images are degraded by compression, camera shake, and poor lighting.
arXiv:2609.00868v1 Announce Type: cross Abstract: Vision-language models are evaluated by aggregate accuracy on multimodal benchmarks, a practice that implicitly assumes the model uses its visual inp...
SpatialUQ is a post‑hoc uncertainty quantification method that uses only the output probabilities of frozen black‑box vision models. It computes the Jensen‑Shannon divergence between the global prediction and the mean of five fixed spatial crops across six deterministic forward passes, assuming that trustworthy predictions are spatially consistent. On the NIH ChestX‑ray14 dataset, SpatialUQ’s Multicrop Uncertainty Score (MUS) achieves a 0.784 failure‑detection AUC—significantly higher than MC‑Dropout—while also providing superior native calibration and improving further when fused with other uncertainty signals.
arXiv:2610.19763v1 Announce Type: new Abstract: Physics-guided networks for underwater image restoration predict transmission and backscatter and invert the image-formation model, yet rarely test whe...
arXiv:2609.09184v1 Announce Type: new Abstract: Vision-language model (VLM) confidence may change in aggregate when visual evidence is degraded while remaining structurally inconsistent within indivi...
arXiv:2606. 15910v2 Announce Type: replace Abstract: A vision-language model can answer a question about a chest radiograph or a pathology slide fluently and confidently while barely using the image, relying instead on language priors.