arXiv AI

Differential privacy representation geometry for medical image analysis

The paper introduces Differential Privacy Representation Geometry for Medical Imaging (DP‑RGMI), a framework that interprets differential privacy as a structured transformation of representation space. DP‑RGMI decomposes performance loss into encoder geometry—measured by representation displacement and spectral effective dimension—and task‑head utilization, quantified by the gap between linear‑probe and end‑to‑end utility. Across 594,000 chest X‑ray images from four datasets, the study finds that differential privacy consistently creates a utilization gap even when linear separability remains, while displacement and spectral dimension vary non‑monotonically with initialization and dataset, indicating that privacy alters representation anisotropy rather than uniformly collapsing features.

arXiv Machine Learning
Jul 27

The pretraining domain outweighs the training objective in setting the privacy-utility trade-off of differentially private medical image analysis

arXiv:2601. 19618v2 Announce Type: replace-cross Abstract: Differential privacy protects the patients whose images train medical imaging models, but it lowers diagnostic accuracy, and the initialization is the strongest known remedy.

By Soroosh Tayebi Arasteh, Mina Farajiamiri, Mahshad Lotfinia, Behrus Hinrichs-Puladi, Jonas Bienzeisler, Mohamed Alhaskir, Mirabela Rusu, Christiane Kuhl, Sven Nebelung, Daniel Truhn
arXiv Machine Learning
Aug 19

Picture the Epsilon: Pursuing Identity-Level Privacy Guarantees for Images

The paper compares four audit methods for assessing identity‑level differential privacy in pre‑trained, black‑box face generators. Each method—GaussMech, KDE‑LR, MMD‑TV, and ROC‑HT—has distinct assumptions, hyperparameters, and finite‑sample limitations, and they produce markedly different epsilon estimates when applied to FaceFusion and InstantID. The study finds that all methods reveal significant identity distinguishability, but none can be reliably ranked in this high‑distinguishability regime, suggesting that future work should evaluate them on partially private mechanisms.

By Arman Zareian Jahromi, Vishnu Bondalakunta, Mohammad Akbar Bin Shah, Naimul Haque, Shuangqing Wei, George T. Amariucai
Hugging Face Trending Papers
Sep 3

Pushing the (Decision) Boundaries: Dynamically Calibrating Differentially Private Noise to Explainability in Federated Learning

The paper introduces XCal-FL, a federated learning algorithm that dynamically calibrates differential privacy noise using three signals—prediction logit variations, counterfactual margins, and saliency concentration—to improve both predictive accuracy and explanation fidelity. Experiments on medical imaging datasets demonstrate that XCal-FL outperforms static-noise and state‑of‑the‑art adaptive DP methods, achieving over 10% better accuracy and up to five‑fold higher explanation fidelity while using privacy budgets more efficiently. The study reveals that explanation fidelity behaves non‑linearly with privacy loss, indicating that explainability is a separate dimension of the privacy trade‑off that cannot be inferred from utility alone.

arXiv Machine Learning
Sep 4

Pushing the (Decision) Boundaries: Dynamically Calibrating Differentially Private Noise to Explainability in Federated Learning

The paper introduces XCal-FL, a federated learning algorithm that dynamically calibrates differential privacy noise using three signals—prediction logit variations, counterfactual margins, and saliency concentration—to improve both predictive accuracy and explanation fidelity. Experiments on medical imaging datasets demonstrate that XCal-FL outperforms static-noise and state‑of‑the‑art adaptive DP methods, achieving over 10% better accuracy and up to fivefold higher explanation fidelity while using privacy budgets more efficiently. The study highlights that explanation fidelity behaves non‑linearly with privacy loss, indicating that explainability is a separate dimension of the privacy trade‑off.

By Michael Khavkin, Kichang Lee, Jaeho Jin, JeongGil Ko, Eran Toch
Hugging Face Trending Papers
5d ago

Fed-IGTD: A federated learning-based framework for tabular-to-image encoding

Fed-IGTD is a federated learning framework that enables tabular-to-image encoding without centralizing data. It reconstructs a global correlation matrix from local statistics and trains a CNN via Federated Averaging, while applying two differential privacy mechanisms: a one-shot Gaussian noise addition during correlation aggregation and a client‑level DP‑FedAvg during training. Experiments on five datasets show that privacy protection during mapping construction has minimal impact on performance, whereas DP‑FedAvg can significantly degrade utility, especially with small client cohorts and moderate privacy budgets.

arXiv Machine Learning
Aug 20

Jacobian-Guided Anisotropic Noise Reshaping for Enhancing Representation Utility under Local Differential Privacy

The paper introduces Jacobian-Guided Anisotropic Noise Reshaping, a method that improves data utility under Local Differential Privacy by selectively reducing noise in task-relevant subspaces of data representations. It uses the Jacobian of a public downstream model to identify critical directions and reshapes isotropic LDP noise into an anisotropic distribution, preserving privacy while enhancing performance. Experiments on CIFAR-10-C show significant accuracy gains, especially for PrivUnit variants at ε=7.5.

By Youngmok Ha, Viktor Schlegel, Yidan Sun, Anil Anthony Bharath
arXiv AI
Oct 16

FedSumUp: User-Auditable Privacy-Aware Representation Sharing for Resource-Constrained Federated Intelligence

FedSumUp introduces a learnable lossy compressor that generates compact, visually interpretable representations on client devices, reducing privacy leakage and computational overhead. The compressor is trained on the server using a data‑free closed‑loop optimization that minimizes the difference between original and twice‑compressed representations after upsampling. Experiments on BloodMNIST, CIFAR‑10, and ChestMNIST show low reconstruction PSNR, significant client runtime reductions, and competitive classification accuracy while remaining robust to non‑IID data.

By Jingwei Zhao, Tiantong Sun, Yuanyuan Song, Jinhuan Guo, Wei Zishuo, Shengyu Huang, Ziyuan Ren, Wei Chen, Xiaojin Zhang