arXiv Machine Learning

A Van Trees Lower Bound for Fully Interactive Differentially Private Federated Learning

arXiv:2605. 19813v2 Announce Type: replace Abstract: Federated differentially private protocols can communicate over many adaptive rounds and reuse each client's local samples.

arXiv Machine Learning
Aug 27

Differentiated Aggregation to Improve Generalization in Federated Learning

The paper proposes a new federated learning approach called FedALS that reduces communication costs by varying aggregation frequencies across model layers. It derives tighter generalization bounds for one‑round and multi‑round federated learning, linking these bounds to local updates and data heterogeneity. Based on representation‑learning insights, the authors argue that infrequent aggregation of early layers and more frequent aggregation of final layers yields more generalizable models, especially in non‑iid settings, and demonstrate the method’s effectiveness experimentally.

By Peyman Gholami, Hulya Seferoglu
arXiv AI
Sep 2

Provably Efficient Federated Reinforcement Learning with Linear Function Approximation and Logarithmic Communication Cost

The paper introduces Fed‑LSVI, a federated online reinforcement learning algorithm that uses linear function approximation in episodic Markov decision processes. It achieves a regret bound of ≥O(√{Md^3H^4T}) while only exchanging compressed sufficient statistics, thereby meeting privacy constraints. The method reduces communication cost to logarithmic in the number of episodes, a marked improvement over previous approaches that required linear communication.

By Zihang Liang, Haochen Zhang, Lingzhou Xue
arXiv Machine Learning
Sep 25

SPADE-DFL: Communication-Efficient Decentralized Federated Learning via Derivative-Free Linearized ADMM

SPADE-DFL is a communication‑efficient decentralized federated learning algorithm that uses a primal–dual method to allow the number of local function‑value updates between neighbor exchanges to increase with the computation budget while maintaining non‑private convergence rates. For smooth nonconvex objectives, it achieves a time‑averaged stationarity and consensus bound of ≠O(T−1/3) with only ≠Theta(T−2/3) communication rounds, where T is the number of local updates per client. The method also supports client‑level differential privacy by isolating data‑dependent increments, proving privacy for the full interactive transcript and quantifying the resulting optimization error, and demonstrates higher mean test accuracy than existing decentralized learning methods on four classification tasks.

By Mengli Wei, Mengkai Zhu, Jiawen Chen, Wenwu Yu, Duxin Che
arXiv Machine Learning
Sep 15

Privacy Preserving Gossip Learning

arXiv:2609.14778v1 Announce Type: new Abstract: We propose a decentralized privacy-preserving learning algorithm in which each agent holds a single private sample and a shared model. Samples are lear...

By Erkan Bayram, Mohamed-Ali Belabbas, Tamer Ba\c{s}ar