arXiv Machine Learning

Range Penalization: Theoretical Insights with Applications in Federated Learning

arXiv:2606. 10916v1 Announce Type: cross Abstract: This paper introduces range regularization for federated learning with linear systematic components to enhance statistical accuracy and induce cross-client regularity conducive to quantization, coding, and resource efficiency.

arXiv Machine Learning
Aug 27

Differentiated Aggregation to Improve Generalization in Federated Learning

The paper proposes a new federated learning approach called FedALS that reduces communication costs by varying aggregation frequencies across model layers. It derives tighter generalization bounds for one‑round and multi‑round federated learning, linking these bounds to local updates and data heterogeneity. Based on representation‑learning insights, the authors argue that infrequent aggregation of early layers and more frequent aggregation of final layers yields more generalizable models, especially in non‑iid settings, and demonstrate the method’s effectiveness experimentally.

By Peyman Gholami, Hulya Seferoglu
arXiv Machine Learning
Jun 10

FedSLoP: Memory-Efficient Federated Learning with Low-Rank Gradient Projection

arXiv:2604. 24012v3 Announce Type: replace Abstract: Federated learning enables a population of clients to collaboratively train machine learning models without exchanging their raw data, but standard algorithms such as FedAvg suffer from slow convergence and high communication and memory costs in heterogeneous, resource-constrained environments.

By Yutong He, Zhengyang Huang, Jiahe Geng, Kun Yuan
arXiv Machine Learning
Sep 18

Distributionally Robust Federated Learning with Multi-Source Data

The paper proposes a distributionally robust federated learning framework that handles both cross-client mixture uncertainty and within-client distributional ambiguity. It constructs a global ambiguity set as a union of local ambiguity sets, allowing client-specific ambiguity radii and a client-wise separable reformulation. The authors provide a high‑probability out‑of‑sample performance guarantee, develop a penalty‑based federated algorithm, prove its convergence under milder conditions, and validate its effectiveness through simulations.

By Yingzhu Liu, Zhongkui Li, Pengcheng You, Ashish Cherukuri