arXiv Computer Vision

Privacy Leakage on DNNs: A Survey of Model Inversion Attacks and Defenses

The paper "Privacy Leakage on DNNs: A Survey of Model Inversion Attacks and Defenses" provides a comprehensive review of model inversion (MI) attacks that exploit trained deep neural networks to reconstruct private training data. It traces the evolution of MI from early machine‑learning contexts to recent DNN‑based attacks across various modalities and learning tasks, offering a detailed taxonomy and comparative analysis of both attacks and defenses. The authors also present an open‑source toolbox on GitHub to support further research in this area.

arXiv Machine Learning
Aug 27

Provable Privacy Attacks on Trained Shallow Neural Networks

The paper investigates provable privacy attacks on trained 2‑layer ReLU neural networks, specifically membership inference and data reconstruction. It demonstrates that the implicit bias of such networks can be leveraged to identify, with high probability, whether a given point was part of the training set in high‑dimensional, nearly orthogonal settings, and to construct a finite set containing a constant fraction of training points in a univariate setting. This work claims to be the first to reveal provable vulnerabilities arising from implicit bias in shallow neural networks.

By Guy Smorodinsky, Gal Vardi, Itay Safran
arXiv Machine Learning
6d ago

Timing is Everything: Inferring Temporal Membership in Continually Updated Models

The paper "Timing is Everything: Inferring Temporal Membership in Continually Updated Models" presents the first systematic study of temporal privacy risk in continually updated deep learning models. It formalizes temporal membership and introduces the temporal membership inference attack (TMIA), a black-box method that uses bidirectional LSTMs to infer when individual samples were used in training at both timestamp- and interval-level granularity. Experiments on language and image models demonstrate TMIA’s effectiveness, and the authors evaluate three defenses, highlighting a trade-off between privacy protection and model utility.

By Jie Fu, Xiangpeng Deng, Yuan Hong, Wendy Hui Wang