arXiv Machine Learning

FAIRVAR: Fair Federated Learning via Variance Regularization

arXiv:2508. 12042v3 Announce Type: replace Abstract: Federated learning (FL) allows collaborative training of machine learning models across multiple parties without sharing raw data.

arXiv Machine Learning
1d ago

Latent Information Sharing for Accelerating Federated Learning

The paper introduces a latent information sharing scheme for federated learning that mitigates client drift by sharing a small amount of hidden‑layer activations. The authors demonstrate both theoretically and empirically that this approach improves training efficiency while maintaining convergence guarantees and data privacy. Compared to existing methods such as FedProx, SCAFFOLD, FedPVR, FedProto, and SplitFed, the proposed method achieves higher model accuracy within a fixed round budget without adding significant communication overhead.

By Seungjun Lee, Ensieh Khazaei, Dimitrios Hatzinakos, Baturalp Buyukates, Sunwoo Lee
arXiv Machine Learning
Sep 23

FairMean: Promoting Fairness in Distributed Learning under Label Poisoning Attacks

FairMean is a new approach for distributed learning that addresses the conflict between fairness and robustness to label poisoning attacks. It assigns weights to client gradients based on a bounded, nondecreasing function of local loss, giving higher weight to high‑loss clients to promote fairness while limiting the influence of poisoned clients. The method is shown to improve fairness compared to standard average‑loss minimization and to reduce accuracy variance while boosting worst‑client accuracy in experiments.

By Huigan Zheng, Jiaojiao Zhang, Yongxiang Liu
Hugging Face Trending Papers
Aug 10

FedTVD: Balancing Data Quality and Quantity for Robust Federated Learning

Federated Learning (FL) enables collaborative model training across distributed client devices while preserving data privacy. However, FL faces significant challenges due to data heterogeneity, particularly in terms of label distribution skewness and variations in dataset sizes, which can lead to biased model updates and hinder convergence.

arXiv Machine Learning
Sep 15

Pathwise Individual Rationality in Federated Learning: A Mechanism-Architecture Co-Design

The paper investigates the trade‑off between the costs of participating in federated learning (privacy, communication, compute) and the potential gains in model performance, framing this as a game‑theoretic problem of individual rationality versus autarky. It shows that clients can remain below their local‑training baseline for many rounds and that simply capping per‑round contributions harms learning. The authors propose a new mechanism that provides short‑term participation guarantees and personalized model evaluation, demonstrating theoretically and empirically that clients can avoid short‑term losses without significantly harming overall performance, even under moderate heterogeneity.

By Amin Meghrazi, Srinivasan Parthasarathy, Andrew Perrault