arXiv Machine Learning

Actually, All Learnable Distribution Classes Are Privately Learnable

arXiv:2610. 28878v1 Announce Type: new Abstract: We show that every class of distributions that is learnable up to arbitrarily small target error in total variation distance with finitely many samples is also learnable under ($\varepsilon, \delta$)-differential privacy up to arbitrarily small target error with finitely many samples.

arXiv Machine Learning
Oct 2

Certification-Based Differentially Private Learning

The paper extends the abstract gradient training (AGT) framework to provide tighter differential privacy guarantees for both private prediction and private learning. It introduces Abstract Gradient Sampling (AGS) to analyze privacy in continuous, unbounded regression and offers theoretical and empirical evidence that these methods yield tighter bounds than global-sensitivity baselines, even in previously unbounded settings. The authors also demonstrate that their private learning algorithm can outperform standard private learners under comparable conditions.

By Mihnea Ghitu, Matthew Wicker
arXiv Machine Learning
Sep 15

Privacy Preserving Gossip Learning

arXiv:2609.14778v1 Announce Type: new Abstract: We propose a decentralized privacy-preserving learning algorithm in which each agent holds a single private sample and a shared model. Samples are lear...

By Erkan Bayram, Mohamed-Ali Belabbas, Tamer Ba\c{s}ar
arXiv Machine Learning
Oct 16

Efficient Agnostic Learning of Univariate Densities Under Local Differential Privacy

The paper introduces a general framework for non‑interactive locally differentially private (LDP) learning of structured univariate distributions that can be approximated by piece‑wise polynomials. It achieves the first sample‑efficient LDP learners for several distribution classes, notably mixtures of log‑concave distributions such as Gaussian mixture models (GMMs), while providing agnostic guarantees and computational efficiency. The authors also establish a new lower bound for learning GMMs under LDP, surpassing previous pure‑DP packing bounds, and develop an efficient non‑interactive LDP algorithm for synthetic data generation over large domains, which is then combined with a deterministic adaptation of a non‑private piecewise polynomial learner.

By Mohammad Afzali, Hassan Ashtiani, Sivan Sabato
arXiv Machine Learning
Oct 5

Differential Privacy as a Perk: Federated Learning over Multiple-Access Fading Channels with a Multi-Antenna Base Station

The paper investigates federated learning over multiple‑access fading channels with a multi‑antenna base station, focusing on user‑level differential privacy (DP). It shows that DP can be achieved as a natural benefit of channel noise without adding artificial noise, deriving new DP and convergence bounds for general bounded‑domain models and non‑convex loss functions. The authors further optimize beamforming and power allocation to characterize the trade‑off between privacy and convergence, providing theoretical insights and numerical validation.

By Hao Liang, Haifeng Wen, Kaishun Wu, Khaled B. Letaief, Hong Xing