arXiv Machine Learning
Personalized Federated Learning through Global Knowledge Distillation and Local Head Adaptation
Read the original on arXiv Machine Learning →The Flow has not summarised this story yet — read it at arXiv Machine Learning.
Related stories
Hugging Face Trending Papers
Aug 24
FedCC: Towards Addressing Label Distribution Skews in Distillation-Based Federated Learning
Federated Learning (FL) enables distributed clients to collaboratively train models without sharing raw data, making it promising for leveraging massive devices in communication networks. In distillat...
arXiv AI
Aug 25
FedCC: Towards Addressing Label Distribution Skews in Distillation-Based Federated Learning
FedCC is a new algorithm for distillation-based federated learning that tackles label distribution skew by allowing clients to mark ambiguous samples as 'unknown' instead of forcing a potentially wrong classification. By adding this extra class and calibrating pseudo-labels on a public dataset, FedCC balances confidence across majority and minority classes. Experiments show that FedCC outperforms existing methods, achieving 67.3% accuracy even when each client has data from only one of ten classes, whereas baselines drop to near-random performance.
arXiv Machine Learning
Aug 18
FedADB: Class Anchor-Driven Dual-Branch Federated Learning for Mitigating Forgetting
arXiv:2608. 15310v1 Announce Type: cross Abstract: Multimodal data collected by heterogeneous devices are used for collaborative training, where federated learning (FL) serves as a key paradigm for effective distributed modeling with data privacy preservation.
arXiv Machine Learning
Sep 22
Tackling Feature-Classifier Mismatch in Federated Learning via Prompt-Driven Feature Transformation
The paper introduces FedPFT, a federated learning framework that tackles the feature‑classifier mismatch problem by using personalized prompts processed through a shared self‑attention transformation module. Unlike prior methods that either degrade the feature extractor or address the mismatch only after training, FedPFT aligns local features with the global classifier during training, improving aggregation and model performance. Experiments demonstrate that FedPFT surpasses state‑of‑the‑art methods by up to 5.07%, and gains up to 7.08% when combined with collaborative contrastive learning.
arXiv Machine Learning
Jun 15
FedSPC: Shared Parameter Correction for Personalized Federated Learning
arXiv:2606. 13748v1 Announce Type: new Abstract: Personalized federated learning (PFL) is one of the important approaches in federated learning for addressing statistical heterogeneity while enabling client-specific adaptation.
arXiv AI
Jun 30
Fisher-Routed Mixture of Experts for Federated Class-Incremental Learning
arXiv:2606. 28835v1 Announce Type: cross Abstract: Federated Learning (FL) emerged as a promising distributed machine learning paradigm.