arXiv Machine Learning

Variational Outlier-Robust Gaussian Process Regression with Generative Modeling

arXiv:2608. 16606v1 Announce Type: new Abstract: Outliers can substantially distort Gaussian process regression (GPR) due to its conventional Gaussian observation likelihood, leading to inaccurate model learning and prediction.

arXiv Machine Learning
3d ago

Predictively Oriented Gaussian Process Posteriors

arXiv:2610.03201v1 Announce Type: cross Abstract: Gaussian Processes (GPs) are a powerful tool for modelling and quantifying uncertainty in functional relationships. However, they require practitione...

By Callum Lau, Jeremias Knoblauch, Louis Sharrock
arXiv Machine Learning
3d ago

Amortized Structured Stochastic Variational Inference for Gaussian Process Latent Variable Models

The paper introduces Amortized Structured Stochastic Variational Inference for Gaussian Process Latent Variable Models, enabling the variational posterior over latent variables to depend on GP inducing points. This approach addresses limitations of mean‑field approximations and yields improved reconstruction metrics for data manifold points.

By Maksym Tretiakov, Sarah Lucie Filipp, Vincent Fortuin, Ruth Misener, Ruby Sedgwick, James Odgers
arXiv Machine Learning
Sep 18

Personalized Federated Hierarchical Gaussian Processes for Privacy-Preserving Modeling of Heterogeneous Distributed Systems

The paper introduces Personalized Federated Hierarchical Gaussian Processes (pFedHGP), a method for probabilistic regression and classification on data distributed across heterogeneous clients. Each client’s latent function is split into a shared global component, a client‑specific deviation that shares the global kernel, and a flexible local residual. Using sparse inducing‑variable approximations and federated variational inference, raw data remain local while the server exchanges only low‑dimensional statistics, enabling full predictive distributions for uncertainty‑aware decisions. In experiments, pFedHGP achieves perfect fault classification in press tonnage monitoring with only 13.77% of labeled cycles and accurately recovers geographic zones in federated air‑quality modeling without centralizing station‑level time series.

By Xianjian Xie, Hao Yan
arXiv Machine Learning
Sep 18

Online Adaptive Kernel Mixing for Gaussian Process Decision Making

The paper introduces HACK GPs, a method that treats kernel selection for Gaussian Processes as an online learning problem with expert advice. Each candidate kernel is viewed as a GP expert, and a distribution over these experts is updated online using AdaHedge based on a loss that reflects both function fit and task alignment. Two variants—Mixture of Gaussians and categorical sampling—are presented, with theoretical guarantees that the weight concentrates on the best kernel under a loss‑gap condition, and empirical results show robust performance across Bayesian optimization, level set estimation, and Bayesian active learning compared to standard kernels and simple ensembles.

By Kavin Aravindan, Mani Tej Sriram, Gautam Dasarathy, Tejas Bodas
Hugging Face Trending Papers
Aug 13

Wasserstein Filtering: A Sample Selection Method for Robust Distribution Learning

Given a dataset where a portion of the samples are contaminated, our goal is to recover the underlying clean population distribution. To this end, we propose Wasserstein Filtering (WF), a novel sample selection framework that discards a fraction of suspicious samples and estimates the target distribution using the empirical measure of the remaining data.