arXiv Machine Learning By Akshay Balsubramani

Information on trajectories: martingales and random times

Read the original on arXiv Machine Learning →

arXiv:2608. 20337v1 Announce Type: cross Abstract: Accounting for information flow on the path space of trajectories of a nonnegative martingale yields exact variational identities for it, even at arbitrary random times.

Machine-generated by The Flow from the publisher's headline and feed description — not written or checked by a human. The full article lives at arXiv Machine Learning.

arXiv Machine Learning
Sep 25

The Impossible Trinity of Time-Series Validation: A Conservation Law among Training Sufficiency, Test Coverage, and Temporal Causality

The paper proves that in time‑series validation three desirable properties—training sufficiency, test coverage, and temporal causality—cannot all be satisfied simultaneously. It introduces quantitative bounds involving the smallest training fraction (α), test coverage (β), future training fraction (Λ), and distance to nearest future training point (δ), showing that exceeding the causal frontier α+β=1 requires training on future data that must lie within (1−α)T of a test point. The authors demonstrate that the impact of such future leakage depends on distance rather than amount, and compare different validation schemes (walk‑forward, k‑fold, purged k‑fold) in terms of their position on this Pareto frontier, illustrating the trade‑offs with empirical results on noise data.

By Jiayu Li
arXiv Machine Learning
Aug 19

The concentration game: Bayesian updating, regret, and information

The paper introduces a two-player zero-sum repeated game between a learner and nature that simultaneously captures Bayesian updating and an exact decomposition of exponential-weights regret. The game’s terminal payoff reflects the maximum gain a comparator can achieve given a fixed relative entropy from the prior, while the one-step constraint limits nature’s move by an information budget. The resulting regret splits into three precise components—per-round information loss, an additive retempering drift, and the comparator’s information relative to the prior—providing a unified framework that explains concentration phenomena, large-deviation bounds, and various learning methods such as bandits, posterior sampling, aggregation, and boosting.

By Akshay Balsubramani
arXiv Machine Learning
Jun 9

A Joint Finite-Sample Certificate for Adaptive Selective Conformal Risk Control

arXiv:2606. 08517v1 Announce Type: new Abstract: Selective predictors answer on confident inputs and abstain elsewhere; deploying one safely needs a single finite-sample certificate that simultaneously upper-bounds the selected risk, lower-bounds the acceptance probability $\pacc$ above a floor $\pmin$, and lower-bounds the deployment utility.

By Xiaoli Yu, Jiamiao Liu