arXiv Machine Learning
RAPTOR: Role-Aware Private Training for Mixture-of-Experts
Read the original on arXiv Machine Learning →The Flow has not summarised this story yet — read it at arXiv Machine Learning.
Related stories
arXiv Machine Learning
Jun 2
IntraShuffler: A Privacy Preserving Framework for Heterogeneous DP Federated Learning
arXiv:2606. 02563v1 Announce Type: new Abstract: Heterogeneous Differential Privacy (HDP) in Federated Learning (FL) allows clients to select individual privacy budgets ($\varepsilon_i$) according to institutional policies and data sensitivity.
Hugging Face Trending Papers
Jun 1
IntraShuffler: A Privacy Preserving Framework for Heterogeneous DP Federated Learning
Heterogeneous Differential Privacy (HDP) in Federated Learning (FL) allows clients to select individual privacy budgets ($\varepsilon_i$) according to institutional policies and data sensitivity. In practice, many HDP-FL systems employ $\varepsilon$-aware server aggregation to improve model utility by re-weighting client updates according to their declared privacy budgets.
arXiv Machine Learning
Jun 15
Private Prediction via PAC Privacy
arXiv:2601. 14033v2 Announce Type: replace Abstract: Machine learning models are increasingly served behind APIs.
Hugging Face Trending Papers
Aug 10
DistMoE: Private-data Rehearsal-free Routing in Mixture-of-Experts for Distributed Instruction Tuning
Multimodal Large Language Models (MLLMs) have shown strong multimodal instruction-following ability, but adapting them to diverse visual-language domains typically assumes centralized data access and costly joint training. This is restrictive when data is distributed across private, domain-specific, or permission-limited clients.
arXiv Machine Learning
Aug 11
Beyond Routing: Decoupling Expert Dispatch and Aggregation in Sparse Mixture-of-Experts
arXiv:2608. 08853v1 Announce Type: new Abstract: Sparse Mixture-of-Experts (MoE) routers commonly use the same scores both to select experts and to weight their already-computed outputs.
arXiv Machine Learning
Aug 18
An Adaptive Gradient Clipping and Noise Injection Mechanism for Differentially Private Federated Learning
arXiv:2608. 15153v1 Announce Type: cross Abstract: Differentially private federated learning must balance privacy protection against model accuracy and training efficiency.