The paper presents an exact, efficient solution for the Linear Model of Co‑regionalization (LMC) multitask Gaussian Process by decoupling latent processes under a mild noise‑model assumption. It introduces a full parametrization of the resulting projected LMC, enabling linear‑time optimization and simplifying tasks such as training updates and leave‑one‑out cross‑validation. Experiments on synthetic and real data demonstrate that projected LMC is competitive with state‑of‑the‑art multitask GP models while offering greater interpretability and computational ease.
arXiv:2512. 06143v2 Announce Type: replace Abstract: Despite a large corpus of recent work on scaling up Gaussian processes, a stubborn trade-off between computational speed, prediction and uncertainty quantification accuracy, and customizability persists.
arXiv:2402.03809v2 Announce Type: replace-cross Abstract: Gaussian processes are a widely embraced technique for regression due to their good prediction accuracy, analytical tractability, and built-i...
The paper introduces a scalable Bayesian method for conditional density estimation using a logistic Gaussian process. It models the log conditional density with a separable covariance— a Matérn kernel on the response dimension and a Nyström-feature kernel on covariates— and samples the latent field via kinetic Langevin dynamics instead of traditional approximations. Experiments on photometric‑redshift data with up to 3.9 million observations show the approach matches state‑of‑the‑art tabular foundation models on density and calibration metrics.
arXiv:2608.29349v1 Announce Type: new Abstract: Gaussian process (GP) regression with a single global GP (GP-glo) incurs cubic computational cost, limiting scalability to large datasets. Product-of-e...
The paper introduces BO-pro-c, a Bayesian optimisation algorithm that employs a product-of-experts Gaussian process (GP-pro-c) as its surrogate model. GP-pro-c combines multiple local GP experts to improve uncertainty quantification, reduce computational cost, and preserve global correlations, addressing the cubic complexity of single global GP models. Experiments show that BO-pro-c achieves competitive optimisation performance with a 0.9% lower simple regret and a 39.4% reduction in computational overhead compared to a single‑global‑GP baseline.
arXiv:2608. 11917v1 Announce Type: new Abstract: Multi-output Gaussian process regression scales cubically in the number of observations times outputs, and dense kernel-matrix methods need bespoke handling whenever different outputs are observed at different inputs.
arXiv:2603. 22050v2 Announce Type: replace-cross Abstract: Supervised machine learning describes the practice of fitting a parameterized model to labeled input-output data.
The paper proposes three information‑theoretic criteria for selecting the most relevant basis functions in sparse Gaussian process regression, tailored to different levels of prior knowledge. Experiments on six UCI regression datasets and three basis families (HSGP, VFF, VISH) show that the no‑data criterion is a robust default, often outperforming simple truncation, while the data‑aware criteria yield significant improvements for HSGP. The study demonstrates that careful basis‑function selection can lead to better performance without increasing computational cost.
arXiv:2511. 16340v2 Announce Type: replace Abstract: Efficient Gaussian process (GP) inference is critical for sequential decision-making tasks such as active learning, online prediction, and Bayesian optimization.
The paper introduces ResTGP, a Bayesian residual tree Gaussian Process framework designed for large, high‑dimensional spatial datasets with heterogeneous structures. It decomposes a Gaussian process across a dyadic tree, iteratively computing predictive and residual processes at each node to capture multi‑scale covariance efficiently. The method employs recursive message passing for linear‑time Bayesian inference and demonstrates posterior consistency, with numerical experiments and a storm surge application highlighting its advantages.
The paper tackles the challenge of predicting multiple high‑dimensional physical fields that must satisfy linear equality constraints, a common scenario in physics‑informed machine learning. It critiques the conventional approach of deducing one field from others, showing its sensitivity to arbitrary choices and its impact on accuracy and uncertainty. To address this, the authors introduce a symmetric framework that first applies a row‑wise PCA to preserve constraints in a latent space, then trains a linearly‑constrained multi‑output Gaussian process using a specially parametrized kernel, and validate the method on population dynamics and CFD problems involving Reynolds stress tensors.
arXiv:2606. 27298v1 Announce Type: cross Abstract: We study the fundamental problem of learning a high-dimensional Gaussian truncated to an unknown halfspace.