arXiv Machine Learning

Adaptive Probability Flow Residual Minimization for High-Dimensional Fokker-Planck Equations

arXiv:2512. 19196v4 Announce Type: replace-cross Abstract: Solving high-dimensional Fokker-Planck (FP) equations remains a challenging problem in computational physics and stochastic dynamics, due to the curse of dimensionality, unbounded domains, and complex probability landscapes.

arXiv Machine Learning
Jun 30

Neural Galerkin Normalizing Flow for Transition Probability Density Functions of Diffusion Models

arXiv:2603. 18907v2 Announce Type: replace Abstract: We propose a new Neural Galerkin Normalizing Flow framework to approximate the transition probability density function of a diffusion process by solving the corresponding Fokker-Planck equation with an atomic initial distribution, parametrically with respect to the location of the initial mass.

By Riccardo Saporiti, Fabio Nobile
arXiv Machine Learning
Aug 27

Improved Analysis for Hessian-free High-resolution Monte Carlo Sampling

The paper introduces Hessian-free high-resolution (HFHR) dynamics, an extension of underdamped Langevin dynamics that incorporates reversible position diffusion for sampling in machine learning. It provides an explicit quantitative contraction rate under a position Poincaré inequality, weighted Hessian and Laplacian bounds, and a compact Sobolev embedding, even when the potential is non‑convex. For the HFHR Monte Carlo algorithm, a path‑space Girsanov argument yields a non‑asymptotic convergence bound and an explicit iteration complexity in total variation distance, improving on previous HFHR results and demonstrating benefits of a positive diffusion parameter through numerical experiments.

By Wujun Lv, Xiaoyu Wang, Yingli Wang, Lingjiong Zhu
Hugging Face Trending Papers
Jun 3

Neural Galerkin Normalizing Flows for Bayesian Inference of Diffusions with Inaccessible Boundaries

One of the primary challenges in Bayesian inference on the parameters of a diffusion model from discrete observations is the unavailability of an analytical expression for the transition density function between consecutive observation times, which is needed to derive the likelihood function. Extending previous studies that solve Fokker-Planck (FP) type partial differential equations with Normalizing Flows, we propose a new Normalizing Flow architecture to learn the transition density function of the diffusion process between two observation times.

arXiv Machine Learning
Jun 4

Neural Galerkin Normalizing Flows for Bayesian Inference of Diffusions with Inaccessible Boundaries

arXiv:2606. 04324v1 Announce Type: new Abstract: One of the primary challenges in Bayesian inference on the parameters of a diffusion model from discrete observations is the unavailability of an analytical expression for the transition density function between consecutive observation times, which is needed to derive the likelihood function.

By Riccardo Saporiti, Fabio Nobile
arXiv Machine Learning
Jul 22

Neural Kolmogorov Equations: Parallelizable Learning of Stochastic Dynamics under General Noise

arXiv:2607. 19173v1 Announce Type: new Abstract: Neural stochastic differential equations (SDEs) have emerged as powerful tools for learning noisy or stochastic dynamics directly from data; however, existing approaches largely assume uncoupled and continuous noise, limiting their applicability to realistic stochastic drivers, and often scale poorly in time, requiring expensive autoregressive training.

By Arthur Bizzi, Olga Fink
arXiv Machine Learning
Aug 20

Self-supervised In-context Operator Learning for Stochastic Mean-Field Control

The paper introduces a mesh‑free, self‑supervised neural operator—called the Normalizing Flow Invertible Solution Transformer (NFIST)—for stochastic mean‑field control (MFC). By reformulating the controlled Fokker–Planck dynamics as a deterministic continuity equation via a probability‑flow ODE and an invertible normalizing‑flow transformer, the authors enable closed‑form score evaluation with linear cost per particle. The resulting operator learns from task prompts (distribution parameters or particle clouds) and can solve unseen MFC tasks in a single forward pass, achieving zero‑shot generalization across applications such as stochastic optimal control, Schrödinger bridges, systemic‑risk control, and obstacle‑avoiding path planning.

By Suyi Gao, Mo Zhou, Rongjie Lai
arXiv Statistics ML
Aug 27

Continuum-marginal optimal transport: a mesh-free kernel method

The paper introduces a mesh‑free kernel method for continuum‑marginal optimal transport, aiming to recover the minimum‑energy velocity field that reproduces a continuous family of probability marginals. By embedding the weak continuity equation into a reproducing kernel Hilbert space, the authors obtain a sample‑only objective that eliminates spatial discretization. The velocity is represented via a linear‑in‑parameters dictionary or neural network and optimized with mini‑batch stochastic techniques, achieving accurate drift recovery and marginal consistency in synthetic experiments, and the framework also extends to the Nelson problem of stochastic optimal transport.

By Yumiharu Nakano