arXiv AI
LFHE: Local-First Heuristic Evolution for Bounded Local Topology Search in Decentralized Learning with Non-IID Data
Read the original on arXiv AI →The Flow has not summarised this story yet — read it at arXiv AI.
Related stories
arXiv AI
Oct 9
Population Scaling or Data Dilution? Dynamics of Local Topology Evolution in Decentralized Learning
The paper investigates how scaling the number of clients in decentralized learning affects information propagation, consensus, and accuracy. By comparing a degree‑two Ring, a Static Random graph, and a locally adaptive Local‑First Heuristic Evolution (LFHE) topology on CIFAR‑10, the authors show that the Ring’s spectral gap decays as Θ(N⁻²), leading to slower convergence and higher disagreement. Experiments reveal that keeping local dataset size constant mitigates population penalties, and that LFHE can improve accuracy and consensus at the cost of increased communication.
arXiv AI
4d ago
Connectivity-Aware Client Selection in Decentralized Federated Learning
The paper introduces connectivity-aware client selection for decentralized federated learning, using spectral graph tools to choose a subset of structurally relevant neighbors for each client. By leveraging eigenvector embeddings and heat/diffusion kernel similarities, the method reduces communication overhead while maintaining or improving accuracy compared to uniform subsampling and full broadcasting. Experiments show up to a 3‑percentage‑point accuracy gain under strong data heterogeneity and a 50% reduction in transmitted messages.
arXiv Machine Learning
Jun 8
Towards Serverless Semi-Decentralized Federated Learning with Heterogeneous Optimizers
arXiv:2606. 06687v1 Announce Type: new Abstract: We investigate cluster formation, involving the number and composition of clusters, in decentralized federated learning (FL) with heterogeneous machine learning (ML) optimizers.
arXiv Machine Learning
Jul 7
Air-Plan: Query-Optimized Topology Selection for Over-the-Air Decentralized Federated Learning
arXiv:2607. 04254v1 Announce Type: cross Abstract: Over-the-air (OTA) aggregation exploits the superposition property of wireless multiple-access channels to aggregate model updates from multiple devices within a single transmission slot, significantly reducing communication latency.
arXiv Machine Learning
Jun 26
Chisme: Heterogeneity-Aware Gossip Learning
arXiv:2505. 09854v3 Announce Type: replace Abstract: As end-user device capability increases and demand for intelligent services at the Internet's edge rises, distributed learning has emerged as a key enabling technology for the intelligent edge.
arXiv Machine Learning
Jun 29
Learning Peer Influence Probabilities with Linear Contextual Bandits
arXiv:2510. 19119v2 Announce Type: replace Abstract: In networked environments, it is common for users to share recommendations about content, products, services, and possible courses of action.