arXiv Machine Learning

Where Do Two Populations of Persistence Diagrams Differ? Calibrated Local Inference at a Fixed Budget

arXiv AI
Aug 18

CaliBench: Are the Stochastic Dynamics of Video World Models Physically Calibrated?

arXiv:2608. 16829v1 Announce Type: cross Abstract: Video world models approximate the stochastic distribution of physical outcomes through generative sampling, but existing benchmarks score individual generations or compare distributions coarsely over a whole dataset, leaving the fine-grained aleatoric uncertainty of specific phenomena untested.

By Jonathan Sadeghi, Jenny Seidenschwarz, Jesse Allardice, Sirish Srinivasan, Benjamin Graham, Jeffrey Hawke
arXiv Machine Learning
Sep 21

COMPLEX: A Closed-Form Certified Embedding of Multiparameter Persistence Modules

COMPLEX is a closed‑form, training‑free embedding for multiparameter persistence modules that provides both an upper and a lower Lipschitz bound, enabling faithful feature representations. By slicing modules along a near‑diagonal net and embedding each slice with the certified PLACE/PALACE landmark map, the method guarantees that separated modules remain separated in the embedding. On Orbit benchmarks and molecular graph tasks, COMPLEX achieves state‑of‑the‑art accuracy, outperforming existing landmark, transformer, and graph‑based approaches.

By Sushovan Majhi, Atish Mitra, \v{Z}iga Virk, Pramita Bagchi
arXiv Machine Learning
Oct 8

SpatialUQ: Post-Hoc Uncertainty Quantification from Spatial Consistency in Black-Box Vision Models

SpatialUQ is a post‑hoc uncertainty quantification method that uses only the output probabilities of frozen black‑box vision models. It computes the Jensen‑Shannon divergence between the global prediction and the mean of five fixed spatial crops across six deterministic forward passes, assuming that trustworthy predictions are spatially consistent. On the NIH ChestX‑ray14 dataset, SpatialUQ’s Multicrop Uncertainty Score (MUS) achieves a 0.784 failure‑detection AUC—significantly higher than MC‑Dropout—while also providing superior native calibration and improving further when fused with other uncertainty signals.

By Md Kawsher Mahbub, Milon Biswas, Mirza Niaz Morshed, Wei Yu
arXiv Computer Vision
Sep 16

Symmetry-Aware Likelihood-Orbit Aggregation for Selective Left-Right Claim Verification

The paper introduces Relation‑Orbit, a symmetry‑aware method for aggregating likelihoods from frozen vision‑language models to verify fine‑grained left‑right claims. It uses a closed‑form contrast that assigns eight normalized likelihoods based on reflection, inverse relation, and entity exchange, and asserts a claim only when the signed contrast exceeds a threshold chosen via Clopper‑Pearson bounds. Experiments on VSR, GQA, and LLaVA‑1.5/COCO show that Relation‑Orbit achieves higher mean test coverage at a 10% selective‑risk calibration target compared to an all‑eight Orbit‑Max baseline across multiple dataset‑backbone settings.

By Zhouzhi Xiong, Chuxi Zhang, Weizhen He, Yi Chen, Qi Li, Donglian Qi
arXiv Machine Learning
Sep 10

A Closed-Form Estimator and Diagnostic Battery for Anchor-Judge Error Correlation, Under a Single-Common-Factor Model

The paper presents a closed‑form estimator for the contamination correlation between anchors and judges under a single‑common‑factor model, requiring at least two judges and two anchors. It introduces a diagnostic battery—including judge‑covariance dispersion, over‑identification tests, a family‑block test, bootstrap confidence intervals, and a weak‑identification screen—to validate the estimator and detect violations. The authors also discuss identification limits for ordinal data and report that real panels have not yet passed the model‑adequacy pre‑test, while simulation studies confirm the estimator’s performance.

By Veerendra Kumar Sunkavalli