arXiv Machine Learning

How Murky Before a VLM Knows It Cannot See? Accuracy, Confidence and Abstention on a Physical Visibility Axis

arXiv Machine Learning
Oct 8

SpatialUQ: Post-Hoc Uncertainty Quantification from Spatial Consistency in Black-Box Vision Models

SpatialUQ is a post‑hoc uncertainty quantification method that uses only the output probabilities of frozen black‑box vision models. It computes the Jensen‑Shannon divergence between the global prediction and the mean of five fixed spatial crops across six deterministic forward passes, assuming that trustworthy predictions are spatially consistent. On the NIH ChestX‑ray14 dataset, SpatialUQ’s Multicrop Uncertainty Score (MUS) achieves a 0.784 failure‑detection AUC—significantly higher than MC‑Dropout—while also providing superior native calibration and improving further when fused with other uncertainty signals.

By Md Kawsher Mahbub, Milon Biswas, Mirza Niaz Morshed, Wei Yu
arXiv AI
Sep 12

Can Edge-Deployable Vision-Language Models Identify Species?

arXiv:2609. 11916v1 Announce Type: new Abstract: Camera traps often run in the field on edge hardware with limited or no connectivity, making small, locally-deployable vision-language models (VLMs) -- not frontier-scale ones -- the practically relevant class to evaluate for species identification.

By William Zhou, Mayukha Siripuram, Xiao Yan, Ziqi Liu, Yi Ding
arXiv Computer Vision
Sep 25

Can Frozen Hyperspherical Features Guide the Selection of Pseudo Masks?

The paper introduces SphereTrust, a method that uses frozen self‑supervised hyperspherical features to evaluate and rank candidate masks produced by foundation segmenters like SAM. By measuring angular contrast, foreground coverage, and image‑frame contact, SphereTrust can select high‑quality masks in 0.55 s per image and outperforms existing baselines on multiple segmentation tasks. The selected masks are then used as priors to train student models, improving performance on several benchmark datasets.

By Xinge Guo, Fengyang Xiao, Dingming Zhang, Yuhan Chen, Rihan Zhang, Xingjian Li, Tianyang Wang, Chunming He, Sina Farsiu