arXiv Machine Learning By Lucas Rosenblatt, R. Teal Witter, Christopher Musco

Differentially Private Synthetic Data from Sliced Chebyshev Moments

Read the original on arXiv Machine Learning →

The paper introduces SPLICE, a differentially private synthetic data algorithm that uses noisy sliced Chebyshev polynomial moments to fit a distribution. SPLICE achieves a Sliced Wasserstein-1 distance of ∼O(1/√n) from the target distribution, a bound that does not depend on the data dimension. The authors also prove a new moment‑matching result and provide a practical implementation that outperforms existing DP synthetic data methods on a large benchmark.

Machine-generated by The Flow from the publisher's headline and feed description — not written or checked by a human. The full article lives at arXiv Machine Learning.

arXiv Machine Learning
Oct 28

Gaussian Approximation for Composition and Subsampling of Differentially Private Algorithms

The paper presents a Gaussian approximation for the privacy loss distribution in differentially private stochastic gradient descent (DP‑SGD) when subsampling is used. It shows that, after truncating rare large losses, the privacy loss behaves like a Gaussian with the same mean and variance, up to a small shift that grows only logarithmically with the error tolerance. This leads to tighter variance‑based bounds for subsampled mechanisms, improving upon previous Renyi‑divergence analyses and explaining the effectiveness of the connect‑the‑dots method for random allocation sampling.

By Vitaly Feldman, Moshe Shenfeld