arXiv AI By Umberto Biccari, Yongcun Song

When to spend privacy: optimal allocation in private learning

Read the original on arXiv AI →

The paper presents a framework for optimally allocating a fixed privacy budget across iterations of Differentially Private Stochastic Gradient Descent. By modeling the Gaussian noise-variance schedule as an open-loop control problem under a zero-Concentrated Differential Privacy constraint, the authors derive an exact-budget simplex formulation and introduce the Privacy‑Budget Adjoint Mirror Descent (PB‑AMD) algorithm. The method guarantees budget exhaustiveness, stability, and stationarity, and yields a square‑root allocation law that empirically outperforms existing allocation rules and reduces optimization time compared to projected gradient descent.

Machine-generated by The Flow from the publisher's headline and feed description — not written or checked by a human. The full article lives at arXiv AI.

arXiv Machine Learning
Jul 23

Differentially Private Neural Network Training Under the Hidden State Assumption

arXiv:2407. 08233v3 Announce Type: replace Abstract: Current differentially private learning paradigms face a severe utility bottleneck: DP-SGD degrades performance through noise accumulation over training steps, while aggregation-based approaches such as PATE suffer from data inefficiency due to disjoint data partitioning.

By Ding Chen, Haochen Luo, Xiaofei Wang, Chen Liu
arXiv Machine Learning
Oct 2

Certification-Based Differentially Private Learning

The paper extends the abstract gradient training (AGT) framework to provide tighter differential privacy guarantees for both private prediction and private learning. It introduces Abstract Gradient Sampling (AGS) to analyze privacy in continuous, unbounded regression and offers theoretical and empirical evidence that these methods yield tighter bounds than global-sensitivity baselines, even in previously unbounded settings. The authors also demonstrate that their private learning algorithm can outperform standard private learners under comparable conditions.

By Mihnea Ghitu, Matthew Wicker