arXiv Machine Learning

Decentralized Federated Learning by Partial Message Exchange

arXiv:2603. 01730v2 Announce Type: replace Abstract: Decentralized federated learning (DFL) has emerged as a transformative server-free paradigm that enables collaborative learning over large-scale heterogeneous networks.

arXiv AI
Jul 7

Decentralised Federated Learning over Temporal Networks: The Role of Heterogeneities

arXiv:2607. 03171v1 Announce Type: cross Abstract: Decentralised federated learning, based on peer-to-peer communication, is increasingly proposed for on-device training of machine learning models, promising a privacy-preserving, communication-efficient training process with no risk of single-point failure.

By Arash Badie-Modiri, Chiara Boldrini, Lorenzo Valerio, J\'anos Kert\'esz, M\'arton Karsai
arXiv Machine Learning
1d ago

Latent Information Sharing for Accelerating Federated Learning

The paper introduces a latent information sharing scheme for federated learning that mitigates client drift by sharing a small amount of hidden‑layer activations. The authors demonstrate both theoretically and empirically that this approach improves training efficiency while maintaining convergence guarantees and data privacy. Compared to existing methods such as FedProx, SCAFFOLD, FedPVR, FedProto, and SplitFed, the proposed method achieves higher model accuracy within a fixed round budget without adding significant communication overhead.

By Seungjun Lee, Ensieh Khazaei, Dimitrios Hatzinakos, Baturalp Buyukates, Sunwoo Lee
arXiv Machine Learning
Sep 25

SPADE-DFL: Communication-Efficient Decentralized Federated Learning via Derivative-Free Linearized ADMM

SPADE-DFL is a communication‑efficient decentralized federated learning algorithm that uses a primal–dual method to allow the number of local function‑value updates between neighbor exchanges to increase with the computation budget while maintaining non‑private convergence rates. For smooth nonconvex objectives, it achieves a time‑averaged stationarity and consensus bound of ≠O(T−1/3) with only ≠Theta(T−2/3) communication rounds, where T is the number of local updates per client. The method also supports client‑level differential privacy by isolating data‑dependent increments, proving privacy for the full interactive transcript and quantifying the resulting optimization error, and demonstrates higher mean test accuracy than existing decentralized learning methods on four classification tasks.

By Mengli Wei, Mengkai Zhu, Jiawen Chen, Wenwu Yu, Duxin Che