arXiv Machine Learning By Takahiro Kato (NP-hard, Inc.)

Sharp and Stable Label-Free Calibration Certificates from Logical Coherence

Read the original on arXiv Machine Learning →

The paper presents a framework for deriving sharp, label‑free calibration certificates for query‑conditioned probabilistic predictors. It establishes minimax lower bounds on calibration residuals under various betting restrictions, shows that these bounds can be discontinuous and that Lipschitz stakes yield stable, sharp bounds. The authors also demonstrate practical algorithms—projected online gradient ascent and anytime‑valid betting—for generating fixed‑horizon and anytime‑valid certificates, and validate the approach on a preregistered study of four predictors across two datasets.

Machine-generated by The Flow from the publisher's headline and feed description — not written or checked by a human. The full article lives at arXiv Machine Learning.

arXiv AI
Sep 3

The Endogeneity of Miscalibration: Impossibility and Escape in Scored Reporting

The paper examines how an agent’s probability report is evaluated twice—once by a strictly proper scoring rule and again by an approval rule that determines a decision. It shows that when the approval rule is welfare‑maximizing, it cannot be affine, yet the resulting distortion is predictable and can be mitigated by a reserve report that neutralizes the cost of pretending to be the marginal type. A Lipschitz rule with a single kink achieves first‑best welfare, while smooth rules cannot, and the key constraint is the steepness of the rule rather than its smoothness.

By Lauri Lov\'en, Sasu Tarkoma