arXiv:2608. 02250v1 Announce Type: new Abstract: Federated learning (FL) is a popular distributed learning framework where multiple clients perform local training and a server aggregates the locally updated models.
By Yuan-Heng Tsai, Li-Hsing Yen, Yan-Wei Chen
The paper introduces a latent information sharing scheme for federated learning that mitigates client drift by sharing a small amount of hidden‑layer activations. The authors demonstrate both theoretically and empirically that this approach improves training efficiency while maintaining convergence guarantees and data privacy. Compared to existing methods such as FedProx, SCAFFOLD, FedPVR, FedProto, and SplitFed, the proposed method achieves higher model accuracy within a fixed round budget without adding significant communication overhead.
By Seungjun Lee, Ensieh Khazaei, Dimitrios Hatzinakos, Baturalp Buyukates, Sunwoo Lee
FairMean is a new approach for distributed learning that addresses the conflict between fairness and robustness to label poisoning attacks. It assigns weights to client gradients based on a bounded, nondecreasing function of local loss, giving higher weight to high‑loss clients to promote fairness while limiting the influence of poisoned clients. The method is shown to improve fairness compared to standard average‑loss minimization and to reduce accuracy variance while boosting worst‑client accuracy in experiments.
By Huigan Zheng, Jiaojiao Zhang, Yongxiang Liu
arXiv:2605. 23145v2 Announce Type: replace-cross Abstract: Individual fairness, the notion that "similar individuals should be treated similarly," provides a strong and flexible fairness guarantee for algorithmic decision makers.
By Conlan Olson, Linjun Zhang, Zhun Deng, Pragya Sur
Federated Learning (FL) enables collaborative model training across distributed client devices while preserving data privacy. However, FL faces significant challenges due to data heterogeneity, particularly in terms of label distribution skewness and variations in dataset sizes, which can lead to biased model updates and hinder convergence.
The paper investigates the trade‑off between the costs of participating in federated learning (privacy, communication, compute) and the potential gains in model performance, framing this as a game‑theoretic problem of individual rationality versus autarky. It shows that clients can remain below their local‑training baseline for many rounds and that simply capping per‑round contributions harms learning. The authors propose a new mechanism that provides short‑term participation guarantees and personalized model evaluation, demonstrating theoretically and empirically that clients can avoid short‑term losses without significantly harming overall performance, even under moderate heterogeneity.
By Amin Meghrazi, Srinivasan Parthasarathy, Andrew Perrault