arXiv AI

Connectivity-Aware Client Selection in Decentralized Federated Learning

The paper introduces connectivity-aware client selection for decentralized federated learning, using spectral graph tools to choose a subset of structurally relevant neighbors for each client. By leveraging eigenvector embeddings and heat/diffusion kernel similarities, the method reduces communication overhead while maintaining or improving accuracy compared to uniform subsampling and full broadcasting. Experiments show up to a 3‑percentage‑point accuracy gain under strong data heterogeneity and a 50% reduction in transmitted messages.

arXiv Machine Learning
Aug 28

Decentralized Multitask Learning over Learned Task Graphs

The paper presents a decentralized multitask learning framework that learns task relationships directly from distributed data. It introduces a two‑phase strategy: first estimating a generalized graph Laplacian from noisy stochastic gradient iterates, then using the learned graph to facilitate cooperative multitask diffusion learning. The authors provide theoretical analysis of Laplacian estimation error, its impact on steady‑state performance, and a topology sensitivity index, and confirm the benefits of learned task graphs through simulations.

By Zirui Wan, Stefan Vlaski
arXiv Machine Learning
Jul 7

Air-Plan: Query-Optimized Topology Selection for Over-the-Air Decentralized Federated Learning

arXiv:2607. 04254v1 Announce Type: cross Abstract: Over-the-air (OTA) aggregation exploits the superposition property of wireless multiple-access channels to aggregate model updates from multiple devices within a single transmission slot, significantly reducing communication latency.

By Kaushal Attaluri, Rebeca P. Diaz-Redondo, Manuel Fernandez Veiga
Hugging Face Trending Papers
Oct 29

More Is Better? Exploring Latent Correspondence in Federated Hypergraph Learning

The paper investigates federated hypergraph learning where local hyperedge releases can correspond to multiple global hypergraph structures, highlighting identifiability and computational challenges. It shows that pairwise assignment of latent correspondences is tractable while multi-client hyperedge matching is generally intractable, and introduces FedASTRA—a method that learns correspondence‑invariant diffusion representations via adaptive heat diffusion and masked latent prediction, communicating only model parameters. Experiments on eight real‑world datasets, including ogbn‑papers100M, demonstrate that FedASTRA achieves state‑of‑the‑art performance‑communication trade‑offs, reaching 50.07 % accuracy and 29.73 % Macro‑F1 while sending only 59.60 MiB per round.

arXiv Machine Learning
Sep 24

Graph Learning with Spectral Connectivity Priors for Scarce Data

The paper introduces Spectral Connectivity-Regularized Graph Learning (SCoGL), a method for learning sparse graphs from limited data by incorporating Laplacian spectral priors that promote global connectivity. SCoGL extends the graphical lasso objective with a connectivity prior derived from Laplacian eigenvalues and uses projected gradient descent with Armijo backtracking for optimization. Experiments demonstrate that SCoGL improves graph recovery and enhances downstream tasks such as graph signal denoising when observations are scarce.

By Mingxiao Liu (Tsinghua University, China), Bahar Oveisgharan (York University, Canada), Bingyan Zou (Tsinghua University, China), Gene Cheung (York University, Canada), H. Vicky Zhao (Tsinghua University, China), Feifei Gao (Tsinghua University, China)