arXiv Machine Learning

Spectrum-Aware Bounds on Invertibility for Privacy-Enhancing Instance Encoding

arXiv Machine Learning
3d ago

From Pixels to Privacy-Sensitive Features: An Information-Theoretic Framework for Reconstruction Bounds

The paper presents an information‑theoretic framework that derives a distortion bound for reconstruction attacks on models trained with DP‑SGD. The bound can be computed before training and applies even when an adversary observes the training trajectory and knows all other training data. It separates the information leaked by training (conditional mutual information) from the inherent uncertainty in the data (source entropy) and uses rate‑distortion theory to produce a lower bound on expected reconstruction error, instantiated in both pixel and LPIPS feature spaces.

By Henry Bourne, Robert F. Allison
arXiv Machine Learning
Aug 18

A Privacy Study of Sparse Collaborative Inference

arXiv:2608. 16236v1 Announce Type: new Abstract: Collaborative inference (CI) splits a model between an edge device and a server, whereby the client computes an intermediate activation, transmits it, and the server completes the computation.

By Maximilian Andreas Hoefler, Karsten Mueller, Wojciech Samek