arXiv Machine Learning By Shamsiiat Abdurakhmanova, Alexander Jung

Federated Soft Clustering via Generalized Total Variation Minimization

Read the original on arXiv Machine Learning →

The paper introduces federated soft clustering for devices in a federated learning network, each fitting a personalized Gaussian mixture model. It proposes Generalized Total Variation Minimization (GTVMin) to couple local maximum likelihood problems via a graph regularizer that penalizes discrepancies between connected nodes’ models. Three discrepancy measures are compared: a squared Euclidean distance requiring component matching, a Monte‑Carlo approximated Kullback‑Leibler divergence, and a closed‑form maximum mean discrepancy; all are optimized with synchronous projected gradient updates, with a convergence guarantee for the smooth MMD instance.

Machine-generated by The Flow from the publisher's headline and feed description — not written or checked by a human. The full article lives at arXiv Machine Learning.

arXiv Machine Learning
Oct 15

A Large-Dimensional Analysis of Least-Squares Federated Learning via Generalized Total Variation Minimization

The paper presents a large‑dimensional analysis of Generalized Total Variation Minimization (GTVMin) for least‑squares federated learning. It shows that Lipschitz observations of the global GTVMin solution concentrate in high dimensions regardless of network structure, and derives exact analytic expressions for performance under both i.i.d. and non‑i.i.d. Gaussian mixture models. These results quantify how regularization balances local adaptation against collaboration, and are validated by experiments on synthetic and real‑world data.

By Ekkehard Schnoor, Malik Tiomoko, Alexander Jung
arXiv Machine Learning
Jun 19

Variational Consensus Monte Carlo for Bayesian Mixture

arXiv:2606. 19643v1 Announce Type: cross Abstract: Motivated by the privacy, sensitivity and sharing limitations of health data, we present a comprehensive pipeline for inference of Bayesian mixture models within a federated learning setting, i.

By Julie Fendler, Francesca L. Crowe, Tom Marshall, Sylvia Richardson, Paul D. W. Kirk