arXiv Statistics ML By Andrew Zammit-Mangion, Lachlan Astfalck, Rapha\"el Huser, Christopher Nemeth, Henry B. Moss

Spatial Prediction with Guided Diffusion

Read the original on arXiv Statistics ML →

Spatial prediction is a key task in analyses of spatially or spatio-temporally referenced data, typically handled with hierarchical models that combine a process model and a data model. The predictive distribution—conditional on observed data—is often intractable, but guided diffusion modeling from machine learning can sample from it when the likelihood is known and differentiable. The authors demonstrate this approach on Gaussian and non‑Gaussian processes, various data models (direct observations, aggregates, counts, censoring, area‑exceedance), validate against exact and MCMC results, and apply it to methane‑flux inversion over the UK and Ireland, showing accurate sampling, applicability to intractable MCMC cases, and good scalability with dimensionality.

Machine-generated by The Flow from the publisher's headline and feed description — not written or checked by a human. The full article lives at arXiv Statistics ML.

arXiv Machine Learning
Oct 12

Transformer-based In-Context Score Operator Learning for Diffusion Models

The paper introduces a transformer-based framework that learns an in‑context score operator for diffusion models, allowing the model to perform reverse‑diffusion sampling on unseen target distributions specified by a small empirical context set. By representing the task‑dependent score as a Gaussian‑kernel conditional mean and approximating it with a transformer‑based query‑dependent attention architecture, the method can adapt to new tasks without retraining or parameter updates. The authors provide theoretical generalization‑error bounds and evaluate the approach on scientific and visual datasets, noting strong performance on simple task families and limitations as task complexity grows.

By Wuzhe Xu, Zhaiming Shen, Yulong Lu, Wenjing Liao, Rongjie Lai