arXiv Machine Learning

PEARL: A Task-Aware Framework for Evaluating Differentially Private Synthetic Educational Data

PEARL is a task-aware framework that evaluates differentially private synthetic educational data by checking validity, privacy protection, predictive usefulness, and suitability for the intended educational task. In a study of 96 settings, only 12 datasets passed all PEARL checks, with many failures due to missing outcome groups or distorted learning activity order. Even datasets that met privacy and predictive-usefulness criteria sometimes exhibited fairness issues and failed to support knowledge-tracing models, indicating that privacy alone does not guarantee practical usefulness.

arXiv AI
Sep 24

"We'll Fix It Later": Education, AI, and the Deferral of Privacy in EdTech

The article "We'll Fix It Later": Education, AI, and the Deferral of Privacy in EdTech examines how educational technology platforms collect sensitive student data but often postpone privacy considerations until later stages of product development. Through 12 interviews and a policy audit of 48 platforms, the study finds that privacy is acknowledged yet deferred in favor of functionality, growth, and funding, with responsibility frequently shifted to cloud providers or downstream institutions. The audit reveals that many platforms lack clear AI disclosures and provide limited governance details, indicating a gap between data collection practices and privacy accountability.

By Meghna Manoj Nair, Rachel Greenstadt
arXiv Machine Learning
1d ago

Rethinking Anonymity Claims in Synthetic Data Generation: A Model-Centric Privacy Attack Perspective

The paper argues that evaluating anonymity in synthetic data generation must focus on the generative model rather than just the resulting dataset. It interprets GDPR definitions of personal data and anonymization under realistic model-access scenarios, mapping these to state‑of‑the‑art privacy attacks. The authors conclude that synthetic data alone is insufficient for anonymization, and that Differential Privacy offers stronger protection than Similarity‑based Privacy Metrics.

By Georgi Ganev, Emiliano De Cristofaro
arXiv AI
Jul 13

How to DP-fy Your Data: A Practical Guide to Generating Synthetic Data With Differential Privacy

arXiv:2512. 03238v2 Announce Type: replace-cross Abstract: High quality data is needed to unlock the full potential of AI for end users.

By Natalia Ponomareva, Zheng Xu, H. Brendan McMahan, Peter Kairouz, Lucas Rosenblatt, Vincent Cohen-Addad, Crist\'obal Guzm\'an, Ryan McKenna, Galen Andrew, Alex Bie, Da Yu, Alex Kurakin, Morteza Zadimoghaddam, Sergei Vassilvitskii, Andreas Terzis
arXiv AI
Jul 23

Recovering Clinical Utility Under Differential Privacy: Empirical Validation of Adaptive Federated Aggregation on Heterogeneous Cardiovascular Datasets

arXiv:2607. 19403v1 Announce Type: cross Abstract: Validating federated learning frameworks on real clinical data is an essential step between proof-of-concept demonstrations in controlled synthetic environments and deployment in real multicenter healthcare settings.

By Rodrigo Tertulino, Laercio Alencar, Ricardo Almeida