arXiv Machine Learning

Federated Targeted Maximum Likelihood Estimation

The paper introduces the first federated algorithm for Targeted Maximum Likelihood Estimation (TMLE), enabling hospitals, banks, or registries to perform TMLE without sharing individual data. Two frameworks—FedTMLE‑G, which aggregates local gradients, and FedTMLE‑L, which allows each institution to complete its own fluctuation fit—are presented, along with a finite‑precision communication protocol that keeps numerical targeting error negligible. The authors also discuss privacy implications, convergence bounds, and trade‑offs between institutional influence and sampling variability.

arXiv Statistics ML
Aug 28

An Accurate and Single-Communication Federated Inference Algorithm

The paper introduces a federated inference algorithm that requires only a single communication round between participating centers and a coordinating server. By extending previous second‑order Taylor expansion methods to third‑order expansions, the algorithm more accurately approximates local log‑likelihood functions, especially when local sample sizes are small. Simulation studies based on real data show that this higher‑order approach improves inference accuracy while maintaining privacy, communication efficiency, and scalability for collaborative biomedical and epidemiological research.

By Laura Montagnani, Anthony CC Coolen, Marianne A Jonker
arXiv Machine Learning
Aug 27

Differentiated Aggregation to Improve Generalization in Federated Learning

The paper proposes a new federated learning approach called FedALS that reduces communication costs by varying aggregation frequencies across model layers. It derives tighter generalization bounds for one‑round and multi‑round federated learning, linking these bounds to local updates and data heterogeneity. Based on representation‑learning insights, the authors argue that infrequent aggregation of early layers and more frequent aggregation of final layers yields more generalizable models, especially in non‑iid settings, and demonstrate the method’s effectiveness experimentally.

By Peyman Gholami, Hulya Seferoglu
arXiv Machine Learning
Jun 19

Variational Consensus Monte Carlo for Bayesian Mixture

arXiv:2606. 19643v1 Announce Type: cross Abstract: Motivated by the privacy, sensitivity and sharing limitations of health data, we present a comprehensive pipeline for inference of Bayesian mixture models within a federated learning setting, i.

By Julie Fendler, Francesca L. Crowe, Tom Marshall, Sylvia Richardson, Paul D. W. Kirk
Hugging Face Trending Papers
Jun 1

IntraShuffler: A Privacy Preserving Framework for Heterogeneous DP Federated Learning

Heterogeneous Differential Privacy (HDP) in Federated Learning (FL) allows clients to select individual privacy budgets ($\varepsilon_i$) according to institutional policies and data sensitivity. In practice, many HDP-FL systems employ $\varepsilon$-aware server aggregation to improve model utility by re-weighting client updates according to their declared privacy budgets.

arXiv Machine Learning
Sep 16

SWB-DM: A Calibrated Sliced-Wasserstein-Barycenter Aggregator with Delayed-Momentum Caching for Byzantine-Robust Federated Learning under Partial Participation

The paper introduces SWB-DM, a Byzantine‑robust federated learning aggregator that treats each slice of a client update as a one‑dimensional distribution, computes a trimmed Wasserstein barycenter across clients, and uses a medoid‑based gauge‑fixing step to recover coordinate identity. It further incorporates delayed‑momentum caching to decouple robustness from the specific clients sampled each round. Extensive experiments on CIFAR‑10, CIFAR‑100, FEMNIST, and a 500‑client scalability run reveal distinct failure modes of existing defenses and demonstrate that SWB‑DM achieves significant gains, especially when compared under equal round budgets.

By Saranraj S, Saranya M S, Alex David S, Ajay Kumar A