arXiv Machine Learning By Peter Moskvichev, Siu Lun Chau, Dino Sejdinovic

Measuring Differences between Conditional Distributions using Kernel Embeddings

Read the original on arXiv Machine Learning →

The paper introduces a unified framework for measuring divergences between conditional distributions using kernel embeddings, termed conditional maximum mean discrepancy (CMMD). It defines a family of CMMD metrics—CMMD_0, CMMD_1, and CMMD_2—each based on different RKHS embeddings, and generalizes them to a level‑s CMMD with clear assumptions and operator‑based smoothing connections. Additionally, the authors present a novel doubly robust estimator for CMMD and demonstrate through experiments that the metric captures complex conditional dependencies for statistical testing.

Machine-generated by The Flow from the publisher's headline and feed description — not written or checked by a human. The full article lives at arXiv Machine Learning.

arXiv Machine Learning
Oct 9

Conditional Kernel Stein Discrepancy

The paper introduces a Conditional Kernel Stein Discrepancy (CKSD) that extends traditional Kernel Stein Discrepancies to evaluate goodness‑of‑fit for conditional distributions. By employing an operator‑valued kernel on the covariate space, the authors lift unconditional KSDs to settings where only a conditional target model and joint samples are available, covering both smooth manifolds and discrete spaces. They prove that the CKSD statistic vanishes exactly when the conditional model matches the true conditional distribution for almost all covariates, and demonstrate its practical effectiveness through experiments on level, power, and runtime.

By Federico Matteucci, Florian Kalinke
arXiv Machine Learning
Jul 28

Minimax Lower Bounds of Kernel Discrepancy Estimation: MMD, HSIC, KSD

arXiv:2607. 24235v1 Announce Type: cross Abstract: Over the past 20 years, kernel discrepancies have been leveraged as a highly powerful tool for quantifying the disagreement of distributions, with numerous successful applications in two-sample, goodness-of-fit, and independence testing, among others.

By Jose Cribeiro-Ramallo, Florian Kalinke, Zolt\'an Szab\'o