arXiv Statistics ML By Sean Plummer

Decision-Sufficient Posterior Approximation

Read the original on arXiv Statistics ML →

The paper studies how a posterior approximation must preserve a specific downstream decision problem. It introduces a regret geometry defined by the target posterior and loss, and uses the forward‑Kullback‑Leibler divergence from a baseline approximation to quantify the information needed for action changes. By analyzing the generalized eigenproblem of the regret Hessian and the baseline information metric, the authors derive a tolerance‑dependent effective dimension and show how restricted approximation families can either miss crucial decision directions or incur excess Fisher information costs.

Machine-generated by The Flow from the publisher's headline and feed description — not written or checked by a human. The full article lives at arXiv Statistics ML.

arXiv Machine Learning
Jun 19

Indexed Bellman Information Complexity

arXiv:2606. 11171v2 Announce Type: replace Abstract: We develop indexed Bellman information complexity, a representation-level theory of interactive decision making centered on information indices and reference histories.

By Yunbei Xu
arXiv Machine Learning
Aug 27

Fast rates in Bayesian online learning with approximate posteriors

The paper investigates how fast predictive regret guarantees of exact Bayesian online learning can be maintained when using approximate posterior methods. It establishes a general theorem linking the cumulative cost of posterior approximation to the contraction radius of the exact Gibbs posterior and the Wasserstein distance between approximate and exact posteriors. Three concrete online learning scenarios—linear models, infinite‑dimensional exponential families, and Gaussian process regression—illustrate that appropriately accurate approximations (projected Langevin, truncation, and sparse variational posteriors) preserve fast regret bounds while reducing computational demands.

By Ilsang Ohn