The paper introduces a new spectral federated learning method that combines local updates and communication compression, addressing key bottlenecks in FL such as data heterogeneity and high communication overhead. It builds on the spectral optimizer Muon, which has shown superiority over Adam-like methods in centralized training, and adapts it to the federated setting. The authors provide rigorous convergence guarantees without requiring the restrictive bounded heterogeneity assumption and validate their approach on standard image classification benchmarks.
arXiv:2601. 00549v2 Announce Type: replace-cross Abstract: The deployment of large-scale neural networks within the Open Radio Access Network (O-RAN) architecture is pivotal for enabling native edge intelligence.
arXiv:2607. 08368v1 Announce Type: new Abstract: With the widespread deployment of basic models in edge intelligence, communication bandwidth has become a core bottleneck restricting the scalability of federated learning.
arXiv:2411. 02908v2 Announce Type: replace Abstract: Scaling large language models (LLMs) demands extensive data and computing resources, which are traditionally constrained to data centers by the high-bandwidth requirements of distributed training.
FedSAP is a federated learning framework that addresses heterogeneous edge devices by using structured pruning as a budget-constrained tri-state channel allocation. It partitions model channels into a Global pool, pseudo-domain-specific Private pools, and a Dropped state, allowing broadly useful features to be shared while isolating domain-sensitive updates. Experiments on Digits and Office-Caltech datasets show FedSAP achieving higher mean global accuracy than the strongest baseline while supporting up to 80% client pruning ratios.
The paper introduces MUC-FL, a block‑wise marginal utility contribution framework that selectively transmits only the most impactful data blocks in federated learning to reduce communication overhead. Applied to a multimodal dataset derived from multiple MIMIC clinical datasets, the method identifies 24 out of 1,135 candidate blocks (1.76%) as carrying meaningful improvement signals, potentially cutting communication by 45‑50% while preserving or enhancing model quality. The deduplication‑based block selection achieves a macro F1 score of 0.8566 versus 0.8155 for standard federated optimization, showing improved performance especially for underrepresented classes.
arXiv:2512. 12737v2 Announce Type: replace Abstract: Decentralized federated learning (DFL) enables collaborative model training without a central server, but converges slowly under statistical heterogeneity.
arXiv:2606. 14416v1 Announce Type: new Abstract: Federated learning (FL) often struggles with generalization due to heterogeneous client data.
arXiv:2607. 06651v1 Announce Type: new Abstract: Federated learning (FL) over mobile and edge devices increasingly involves multimodal models in which clients differ in both sensing capability and computational capacity.
arXiv:2408. 05886v5 Announce Type: replace Abstract: Heterogeneous system configurations of distributed clients connected to the central server (CS) via a time-varying wireless network pose significant challenges for popular distributed machine learning (ML) algorithms such as federated learning (FL).
The paper introduces Layer-wise Budgeted Adaptive Transmission (LBAT), a method that treats federated learning communication as a resource allocation problem under tight uplink budgets. LBAT estimates the transmission value of each layer using local training signals and then applies a byte‑level dynamic programming allocator to choose optimal rank and bit configurations for each layer. Experiments on heterogeneous federated tabular prediction and data generation tasks show that LBAT outperforms uniform compression baselines, achieving better communication‑utility tradeoffs while maintaining distributional fidelity.
arXiv:2607. 17913v1 Announce Type: cross Abstract: Distributed Fine-Tuning (DFT) of large-scale Foundation Models (FMs) on resource-constrained edge devices is limited by local compute constraints and communication overhead.
arXiv:2606. 14354v1 Announce Type: new Abstract: Federated learning is well suited to edge environments but is often limited by the uplink cost of transmitting model updates.