arXiv Machine Learning

Continuous-depth Deep Gaussian Processes

The paper introduces a continuous-depth formulation of Deep Gaussian Processes (DGPs), treating depth as a latent continuous evolution rather than a discrete stack. It proposes two instantiations—CDGP, which applies a GP prior directly to the state–depth drift, and FlowDGP, which uses a flow-evolved prior to capture richer depth dependence at lower training cost. Experiments on synthetic, benchmark, and large-scale regression tasks demonstrate that residual DGP outperforms plain DGP, while CDGP and FlowDGP provide stronger overall performance across the studied regimes.

Hugging Face Trending Papers
Oct 22

Continuous-depth Deep Gaussian Processes

The paper proposes a continuous-depth formulation for Deep Gaussian Processes (DGPs), treating depth as a latent continuous evolution rather than a discrete stack. It introduces two instantiations—CDGP, which applies a GP prior directly to the state–depth drift, and FlowDGP, which uses a flow-evolved prior to capture richer depth dependence at lower training cost. Experiments on synthetic, benchmark, and large-scale regression tasks demonstrate that residual DGP improves over plain DGP, while CDGP and FlowDGP offer stronger performance across the studied regimes.

arXiv Machine Learning
Oct 12

Spanning Diffusion and Flow-based Posterior Sampling via Exact Gaussian Conditioning

The paper introduces β‑Flow, a versatile plug‑and‑play posterior sampling framework that unifies flow‑matching, diffusion, and decorrelated priors through a correlation parameter β and a confidence parameter κ. Each iteration requires only a single denoising network forward pass followed by an exact Gaussian conditioning step, implemented as a Kalman update independent of network gradients. The authors demonstrate that many existing guided samplers are special cases of β‑Flow, and show state‑of‑the‑art performance on seven inverse problems across four datasets, with the ability to tune prior strength based on data informativeness.

By Teo Deveney, Lea Bogensperger, Hok Shing Wong
arXiv Machine Learning
Sep 14

Nonlinear Dimensionality Reduction Techniques for Bayesian Optimization

The paper investigates nonlinear dimensionality reduction for Bayesian optimisation (BO) by transforming high‑dimensional black‑box optimisation problems into a sequence of low‑dimensional latent‑space BO (LSBO) tasks. It extends earlier linear embedding approaches by using variational autoencoders (VAEs), deep metric loss, and adaptive retraining to better capture nonlinear structure, and couples LSBO with sequential domain reduction (SDR‑LSBO) to progressively narrow search domains. Experiments on GPU‑accelerated BoTorch with Matérn‑5/2 Gaussian‑process surrogates show that VAE‑based LSBO outperforms adaptive linear embeddings, and the authors provide a theoretical analysis of latent‑space error versus representation gap under PAC‑Bayes conditions.

By Luo Long, Coralia Cartis, Paz Fink Shustin