arXiv AI
Aug 18

CaliBench: Are the Stochastic Dynamics of Video World Models Physically Calibrated?

arXiv:2608. 16829v1 Announce Type: cross Abstract: Video world models approximate the stochastic distribution of physical outcomes through generative sampling, but existing benchmarks score individual generations or compare distributions coarsely over a whole dataset, leaving the fine-grained aleatoric uncertainty of specific phenomena untested.

By Jonathan Sadeghi, Jenny Seidenschwarz, Jesse Allardice, Sirish Srinivasan, Benjamin Graham, Jeffrey Hawke
arXiv Machine Learning
Sep 21

COMPLEX: A Closed-Form Certified Embedding of Multiparameter Persistence Modules

COMPLEX is a closed‑form, training‑free embedding for multiparameter persistence modules that provides both an upper and a lower Lipschitz bound, enabling faithful feature representations. By slicing modules along a near‑diagonal net and embedding each slice with the certified PLACE/PALACE landmark map, the method guarantees that separated modules remain separated in the embedding. On Orbit benchmarks and molecular graph tasks, COMPLEX achieves state‑of‑the‑art accuracy, outperforming existing landmark, transformer, and graph‑based approaches.

By Sushovan Majhi, Atish Mitra, \v{Z}iga Virk, Pramita Bagchi
arXiv Machine Learning
Oct 8

SpatialUQ: Post-Hoc Uncertainty Quantification from Spatial Consistency in Black-Box Vision Models

SpatialUQ is a post‑hoc uncertainty quantification method that uses only the output probabilities of frozen black‑box vision models. It computes the Jensen‑Shannon divergence between the global prediction and the mean of five fixed spatial crops across six deterministic forward passes, assuming that trustworthy predictions are spatially consistent. On the NIH ChestX‑ray14 dataset, SpatialUQ’s Multicrop Uncertainty Score (MUS) achieves a 0.784 failure‑detection AUC—significantly higher than MC‑Dropout—while also providing superior native calibration and improving further when fused with other uncertainty signals.

By Md Kawsher Mahbub, Milon Biswas, Mirza Niaz Morshed, Wei Yu