arXiv Machine Learning

Learn Only Where You Can't Compute: Structured Corrections to Gaussian Process Posteriors

The paper introduces a structured posterior‑correction framework that blends a tractable Gaussian reference with data‑driven corrections learned via diffusion models. After applying mean correction and covariance calibration, the diffusion model focuses on a low‑dimensional subspace that captures discrepancies from the Gaussian reference, while the remaining space stays Gaussian. Experiments on three scientific inference tasks show that these corrections recover hidden modes, improve sample structure, and reduce prediction error compared to the Gaussian reference, with trade‑offs between accuracy and computational cost relative to full‑field generative models.

arXiv Machine Learning
Oct 5

Predictively Oriented Gaussian Process Posteriors

arXiv:2610.03201v1 Announce Type: cross Abstract: Gaussian Processes (GPs) are a powerful tool for modelling and quantifying uncertainty in functional relationships. However, they require practitione...

By Callum Lau, Jeremias Knoblauch, Louis Sharrock
arXiv AI
Jul 24

PILD: Physics-Informed Learning via Diffusion

arXiv:2601. 21284v2 Announce Type: replace-cross Abstract: Diffusion models have emerged as powerful generative tools for modeling complex data distributions, yet their purely data-driven nature limits applicability in engineering and scientific problems where physical laws must be respected.

By Tianyi Zeng, Tianyi Wang, Jiaru Zhang, Zimo Zeng, Feiyang Zhang, Yiming Xu, Sikai Chen, Junfeng Jiao, Christian Claudel, Xinbo Chen
arXiv Machine Learning
Oct 5

Amortized Structured Stochastic Variational Inference for Gaussian Process Latent Variable Models

The paper introduces Amortized Structured Stochastic Variational Inference for Gaussian Process Latent Variable Models, enabling the variational posterior over latent variables to depend on GP inducing points. This approach addresses limitations of mean‑field approximations and yields improved reconstruction metrics for data manifold points.

By Maksym Tretiakov, Sarah Lucie Filipp, Vincent Fortuin, Ruth Misener, Ruby Sedgwick, James Odgers
arXiv Machine Learning
3d ago

Latent Annealed Posterior Sampling with a Variance-Preserving Bridge for Sparsely Observed Random Fields

The paper introduces Latent Annealed Posterior Sampling (LAPS), a method that maps sparsely observed random fields into a lower‑dimensional latent space and performs posterior sampling there. A variance‑preserving bridge controls local covariance inflation, while flow matching learns the latent prior. Experiments on Gaussian benchmarks, a bimodal posterior, and a Navier‑Stokes field show that LAPS accurately approximates posterior distributions, preserves multiple modes, and keeps conditional sampling costs nearly constant as spatial resolution increases.

By Jiankun Lei, Tian Qi
arXiv Machine Learning
Oct 9

Feature Space Adaptation for Effortless Gaussian Process Flows

The paper introduces improvements to FlowGP, a method for conditional sampling from Gaussian processes outside the linear-Gaussian regime. It adds kernel approximations to scale to high-resolution domains and a new technique for computing marginal likelihood by measuring the work required to steer diffusion toward conditioning statements. These advances enable hyperparameter optimisation within FlowGP and are demonstrated on tasks such as probabilistic downscaling, PDE solution inference on irregular domains, and sea level anomaly field recovery from non-Gaussian satellite data.

By Thomas Cowperthwaite, Louis Sharrock, Lachlan Astfalck, Henry Moss
arXiv AI
Jun 3

Physics-informed diffusion models in spectral space

arXiv:2602. 09708v2 Announce Type: replace-cross Abstract: We propose physics-informed spectral diffusion (PISD), a methodology that combines generative latent diffusion models with physics-informed machine learning to generate solutions of partial differential equations (PDEs) conditioned on partial observations, which includes, in particular, forward and inverse PDE problems.

By Davide Gallon, Philippe von Wurstemberger, Patrick Cheridito, Arnulf Jentzen