arXiv Machine Learning

Personalized Federated Hierarchical Gaussian Processes for Privacy-Preserving Modeling of Heterogeneous Distributed Systems

The paper introduces Personalized Federated Hierarchical Gaussian Processes (pFedHGP), a method for probabilistic regression and classification on data distributed across heterogeneous clients. Each client’s latent function is split into a shared global component, a client‑specific deviation that shares the global kernel, and a flexible local residual. Using sparse inducing‑variable approximations and federated variational inference, raw data remain local while the server exchanges only low‑dimensional statistics, enabling full predictive distributions for uncertainty‑aware decisions. In experiments, pFedHGP achieves perfect fault classification in press tonnage monitoring with only 13.77% of labeled cycles and accurately recovers geographic zones in federated air‑quality modeling without centralizing station‑level time series.

arXiv Machine Learning
Oct 5

Predictively Oriented Gaussian Process Posteriors

arXiv:2610.03201v1 Announce Type: cross Abstract: Gaussian Processes (GPs) are a powerful tool for modelling and quantifying uncertainty in functional relationships. However, they require practitione...

By Callum Lau, Jeremias Knoblauch, Louis Sharrock
arXiv Machine Learning
Sep 18

COIN-GP: Cooperative Online Learning in Networked Distributed Systems with Partial Measurements via Gaussian Process Regression

The paper introduces COIN-GP, an observer‑based cooperative learning framework for distributed sensor networks that jointly estimates system states and partially unknown dynamics using online distributed Gaussian Process regression. It addresses challenges of incomplete state observations and deficient GP models by proposing a novel data collection strategy with theoretical feasibility conditions. The authors also derive an error upper bound for both state and model estimation and demonstrate through simulations that COIN‑GP outperforms existing distributed GP‑based methods.

By Zewen Yang, Xiaobing Dai, Zhenxiao Yin, Hang Zhao, Zhijun Li, C. C. Chan
arXiv Machine Learning
Sep 24

Resource-Efficient Distributed Recursive Gaussian Processes

The paper introduces two distributed recursive Gaussian process algorithms, ADMM‑RGP and PDMM‑RGP, designed for multi‑output regression in multi‑agent systems. It analyzes their stability and convergence, proposes parameter selection strategies to speed up convergence, and demonstrates that the methods reduce communication overhead while preserving estimation accuracy and consensus. Experiments on a real‑world wind dataset confirm the algorithms’ effectiveness across different communication graph connectivities.

By Josephine King, Ali Emre Balci, Raj Thilak Rajan
arXiv Machine Learning
Aug 13

A Factor Graph Approach to Scalable Multi-Output Gaussian Process Regression

arXiv:2608. 11917v1 Announce Type: new Abstract: Multi-output Gaussian process regression scales cubically in the number of observations times outputs, and dense kernel-matrix methods need bespoke handling whenever different outputs are observed at different inputs.

By Wouter W. L. Nuijten, Esther G. van Pelt, Albert Podusenko, \.Ismail \c{S}en\"oz, Wouter M. Kouw
arXiv Machine Learning
Oct 15

A Large-Dimensional Analysis of Least-Squares Federated Learning via Generalized Total Variation Minimization

The paper presents a large‑dimensional analysis of Generalized Total Variation Minimization (GTVMin) for least‑squares federated learning. It shows that Lipschitz observations of the global GTVMin solution concentrate in high dimensions regardless of network structure, and derives exact analytic expressions for performance under both i.i.d. and non‑i.i.d. Gaussian mixture models. These results quantify how regularization balances local adaptation against collaboration, and are validated by experiments on synthetic and real‑world data.

By Ekkehard Schnoor, Malik Tiomoko, Alexander Jung
Hugging Face Trending Papers
Sep 17

COIN-GP: Cooperative Online Learning in Networked Distributed Systems with Partial Measurements via Gaussian Process Regression

The paper introduces COIN-GP, an observer‑based dynamic cooperative learning framework for distributed sensor networks that jointly estimates system states and partially unknown dynamics when only partial state observations are available. It employs online distributed Gaussian Process regression and a novel data‑collection strategy with theoretical feasibility conditions, and derives an error upper bound that combines state and model estimation errors. Simulations show that COIN‑GP outperforms existing distributed GP‑based methods.