arXiv Machine Learning

TabPATE: Differentially Private Tabular In-Context Learning Without Public Data

arXiv:2606. 31474v1 Announce Type: new Abstract: Tabular foundation models enable accurate in-context learning (ICL) from small labeled datasets, but the private records placed in context can leak through model predictions.

arXiv Machine Learning
5d ago

Differentially-Private Decision Trees and Provable Robustness to Data Poisoning

The paper introduces PrivaTree, a differentially‑private decision tree algorithm that uses private histograms to select splits while preserving a small privacy budget. PrivaTree supports mixed numerical and categorical data without leaking information about numerical features and achieves a superior privacy‑utility trade‑off compared to existing methods. Additionally, the authors provide theoretical bounds on the expected accuracy and success rates of backdoor attacks, showing that PrivaTree-trained trees are more robust against data poisoning than standard decision trees.

By Dani\"el Vos, Jelle Vos, Tianyu Li, Zekeriya Erkin, Sicco Verwer
arXiv AI
Sep 4

Privacy-Preserving Heterogeneous Multi-LLM Federated Inference for Cognitive Diagnosis

The paper introduces a federated inference framework that enables multiple commercial large language model (LLM) APIs—such as LLaMA‑3.3‑70B, GPT‑4o‑mini, and Claude‑3‑Haiku—to collaborate on cognitive diagnosis tasks without accessing raw student data or proprietary model internals. Each entity’s predictions are perturbed with Laplace noise to provide epsilon‑local differential privacy, and a residual‑based aggregation scheme mitigates model heterogeneity. Experiments on three educational benchmarks demonstrate strong privacy guarantees with minimal accuracy loss, confirming the framework’s practical usability and cross‑domain generalizability.

By Yagna Manasa Boyapati, Chong Yu, Tianyu Jiang, Justin Zhan