arXiv AI By Ngoc Phu Doan, Chongyan Gu, Ihsen Alouani

Batch Normalization Amplifies Memorization and Privacy Risks

Read the original on arXiv AI →

Batch Normalization (BN) is widely used to speed up and stabilize deep neural network training, yet its effect on privacy and memorization has been largely unexplored. This study shows that BN significantly increases the memorization of atypical or outlier samples, as evidenced by unintended memorization, per-sample influence, and heightened susceptibility to membership inference attacks across multiple datasets and architectures. A mechanistic analysis of the BN backward pass reveals that BN amplifies the per‑step margin growth of outlier samples during training, thereby intensifying their influence.

Machine-generated by The Flow from the publisher's headline and feed description — not written or checked by a human. The full article lives at arXiv AI.

arXiv Machine Learning
Sep 11

Predicting Privacy Leakage from Weight Spectral Density

The paper investigates whether inexpensive spectral metrics from the heavy‑tailed self‑regularisation framework can predict membership inference attack (MIA) vulnerability, offering a scalable alternative to costly shadow‑model attacks. Experiments on image and tabular classification tasks show that stable rank correlates positively with overall MIA success, while Log alpha‑Norm correlates negatively with MIA risk in low false‑positive regimes, outperforming conventional generalisation gap measures. These findings suggest that neural network spectra contain privacy leakage signals not captured by traditional overfitting metrics, pointing to spectral analysis as a promising direction for privacy auditing.

By Richard J. Preen, Jim Smith
arXiv Machine Learning
Jun 2

Causal Evaluation of Membership Inference Attacks

arXiv:2602. 02819v4 Announce Type: replace Abstract: Membership Inference Attacks (MIAs) aim to distinguish training points (members) from unseen data (non-members), and are widely used to quantify memorization and assess privacy risks.

By Mathieu Even, Cl\'ement Berenfeld, Linus Bleistein, Tudor Cebere, Julie Josse, Aur\'elien Bellet
arXiv Computation and Language
Sep 2

Membership Inference in Fine-tuned Diffusion Language Models via Token-level Memorization Asymmetry

The paper introduces a new privacy vulnerability in diffusion language models (DLMs) called token‑level memorization asymmetry, derived from theoretical analysis of diffusion training dynamics. It proposes Q‑Skew, a quantile‑weighted skewness indicator, to perform membership inference on fine‑tuned DLMs, outperforming existing baselines across multiple datasets and models. Additionally, Q‑Skew can be used to extract personally identifiable information (PII), demonstrating a broader privacy attack surface.

By Shengfang Zhai, Leo Marchyok, Yuling Shi, Huanran Chen, Yinpeng Dong, Jiaheng Zhang, Sanghyun Hong