The paper argues that distributed learning—federated and decentralized—should be a core approach for large language model post‑training, rather than an optional privacy measure. It critiques current methods like RLHF and DPO for assuming centralized preference data, citing scientific, practical, and ethical flaws. The authors present a three‑pillar framework (privacy and data sovereignty, pluralism and representational equity, robustness and scalability), formalize technical challenges such as reference drift and preference heterogeneity, and outline algorithmic directions and a research agenda to make distributed post‑training feasible.
arXiv:2606. 04399v1 Announce Type: new Abstract: In the paradigm of decentralized learning, a group of agents collaborate to train a global model using distributed datasets without a central server.
arXiv:2607. 23029v1 Announce Type: cross Abstract: Federated learning enables collaborative model training across distributed clients without centralising their data, yet privacy remains a persistent concern because the shared model updates can leak information about local datasets.
arXiv:2510. 04902v3 Announce Type: replace Abstract: Tuning hyperparameters in federated machine learning can substantially impact model performance.
arXiv:2606. 10595v1 Announce Type: cross Abstract: Federated Learning (FL) has emerged as a promising solution for data hunger in centralized learning.
arXiv:2606. 16891v1 Announce Type: cross Abstract: Federated Learning is rapidly evolving beyond the exchange of traditional model weights and gradients, yet existing definitions fail to capture the full scope of modern payloads like synthetic data and federated analytics.
Privacy-sensitive and distributed characteristics of multi-center medical data bring severe obstacles to centralized modeling for accurate early prediction of sepsis. Federated learning (FL) has attracted growing attention as a promising framework for collaborative model development, as it allows multiple institutions to jointly train predictive models without directly sharing or centralizing raw data.
The paper introduces a federated inference framework that enables multiple commercial large language model (LLM) APIs—such as LLaMA‑3.3‑70B, GPT‑4o‑mini, and Claude‑3‑Haiku—to collaborate on cognitive diagnosis tasks without accessing raw student data or proprietary model internals. Each entity’s predictions are perturbed with Laplace noise to provide epsilon‑local differential privacy, and a residual‑based aggregation scheme mitigates model heterogeneity. Experiments on three educational benchmarks demonstrate strong privacy guarantees with minimal accuracy loss, confirming the framework’s practical usability and cross‑domain generalizability.
arXiv:2502. 17748v4 Announce Type: replace Abstract: Federated Learning (FL) inherently mitigates mass data centralization risks; however, its privacy protections are not equally distributed - leaving vulnerable individuals disproportionately exposed to sophisticated privacy attacks.
arXiv:2609.39684v1 Announce Type: new Abstract: Privacy has become an increasingly important concern in the Document Analysis community, to the extent that in many environments such as archives, gove...
arXiv:2606. 26037v1 Announce Type: cross Abstract: Federated learning has emerged as the foremost approach for decentralized model training with privacy preservation.
arXiv:2609. 28695v1 Announce Type: new Abstract: This work presents a federated framework for training Averaged $n$-Dependence Estimators (AnDE) in distributed environments.
arXiv:2505. 23593v4 Announce Type: replace Abstract: Post-training of foundation language models has emerged as a promising research domain in federated learning (FL) with the goal to enable privacy-preserving model improvements and adaptations to user's downstream tasks.