arXiv Machine Learning By Patrick Seifner, Kostadin Cvejoski, David Berghaus, Cesar Ojeda, Ramses J. Sanchez

In-Context Learning of Stochastic Differential Equations with Foundation Inference Models

Read the original on arXiv Machine Learning →

arXiv:2502. 19049v3 Announce Type: replace Abstract: Stochastic differential equations (SDEs) describe dynamical systems where deterministic flows, governed by a drift function, are superimposed with random fluctuations, dictated by a diffusion function.

Machine-generated by The Flow from the publisher's headline and feed description — not written or checked by a human. The full article lives at arXiv Machine Learning.

arXiv Machine Learning
Jul 22

Neural Kolmogorov Equations: Parallelizable Learning of Stochastic Dynamics under General Noise

arXiv:2607. 19173v1 Announce Type: new Abstract: Neural stochastic differential equations (SDEs) have emerged as powerful tools for learning noisy or stochastic dynamics directly from data; however, existing approaches largely assume uncoupled and continuous noise, limiting their applicability to realistic stochastic drivers, and often scale poorly in time, requiring expensive autoregressive training.

By Arthur Bizzi, Olga Fink
arXiv Machine Learning
Sep 11

Deep operator learning for efficient sampling from invariant measures of stochastic differential equations

The paper presents an amortized neural sampler that merges operator learning with flow-based methods to efficiently sample from invariant measures of stochastic differential equations (SDEs). By mapping SDE coefficient functions to pushforwards from a reference measure, the approach shifts the sampling cost to an initial training phase, after which new SDE instances can be sampled with a single encoder pass and a few ODE solver steps, independent of mixing time. The framework incorporates Lagrangian trajectory sensors and cross attention to handle high-dimensional problems, and the authors provide theoretical guarantees of expressivity and resolution invariance, demonstrating competitive accuracy and significant speedups over MCMC in 1D, 2D, and 64D SDE families.

By Lin Guo, Li Lei, Jingtong Zhang
arXiv Machine Learning
Sep 10

Noise in Diffusion Models Is a Learnable Input

The paper argues that the concrete random noise used in diffusion models is not merely a passive perturbation but a learnable input that can be exploited by the model. By analyzing how clean data and realized noise jointly form the noisy input, the authors show that the model can learn regularities in the data or in the noise structure, and that these two routes can interact. Experiments on MNIST and CIFAR‑10 using pseudorandom streams demonstrate that structured‑noise training can reduce prediction loss, but this advantage disappears when test noise is replaced with IID noise, indicating that the learned dependence is tied to the specific noise structure.

By Shengzhi Deng, Chenqi Ye, Yanze Guo