arXiv AI

Learning Continuous Neural Representation of Stochastic Hybrid Systems

The paper demonstrates that a stochastic hybrid system (SHS), which combines continuous dynamics governed by a stochastic differential equation (SDE) with discrete resets triggered by a Markov kernel, can be approximated by a single SDE in a higher‑dimensional latent space. By encoding the reset branches with auxiliary variables, the resets become deterministic, allowing the system’s manifold to be glued and embedded into Euclidean space. This embedding eliminates the need for explicit reset terms in the hybrid Fokker‑Planck equation, and the authors propose a loss function that matches evolving state distributions, enabling the latent SDE to recover the SHS’s probability evolution without mode labeling, trajectory segmentation, or event‑based simulations.

arXiv Machine Learning
Jun 30

Neural Galerkin Normalizing Flow for Transition Probability Density Functions of Diffusion Models

arXiv:2603. 18907v2 Announce Type: replace Abstract: We propose a new Neural Galerkin Normalizing Flow framework to approximate the transition probability density function of a diffusion process by solving the corresponding Fokker-Planck equation with an atomic initial distribution, parametrically with respect to the location of the initial mass.

By Riccardo Saporiti, Fabio Nobile
arXiv Machine Learning
Jul 22

Neural Kolmogorov Equations: Parallelizable Learning of Stochastic Dynamics under General Noise

arXiv:2607. 19173v1 Announce Type: new Abstract: Neural stochastic differential equations (SDEs) have emerged as powerful tools for learning noisy or stochastic dynamics directly from data; however, existing approaches largely assume uncoupled and continuous noise, limiting their applicability to realistic stochastic drivers, and often scale poorly in time, requiring expensive autoregressive training.

By Arthur Bizzi, Olga Fink
arXiv Machine Learning
Jun 4

Drift-Diffusion Matching: Embedding dynamics in latent manifolds of asymmetric neural networks

arXiv:2602. 14885v2 Announce Type: replace-cross Abstract: Recurrent neural networks (RNNs) provide a theoretical framework for understanding computation in biological neural circuits, yet classical results, such as Hopfield's model of associative memory, rely on symmetric connectivity that restricts network dynamics to gradient-like flows.

By Ram\'on Nartallo-Kaluarachchi, Renaud Lambiotte, Alain Goriely
arXiv Machine Learning
Aug 20

Foundations of Diffusion Models in General State Spaces: A Self-Contained Introduction

The article "Foundations of Diffusion Models in General State Spaces: A Self-Contained Introduction" presents a unified primer on diffusion models that applies to both continuous Euclidean data and discrete categorical structures. It develops discrete-time forward noising via Markov kernels and learned reverse dynamics, and connects these to continuous-time limits such as stochastic differential equations in ρ^d and continuous-time Markov chains on finite alphabets, deriving the corresponding Fokker–Planck and master equations. The work also shows how different forward corruption choices—Gaussian processes for continuous spaces and structured categorical transition kernels for discrete spaces—affect reverse dynamics and the evidence lower bound used in training, offering a layered exposition for newcomers, practitioners, and experts alike.

By Vincent Pauline, Tobias H\"oppe, Kirill Neklyudov, Alexander Tong, Stefan Bauer, Andrea Dittadi
arXiv AI
Jun 2

Strong Stochastic Flow Maps

arXiv:2606. 01086v1 Announce Type: cross Abstract: Flow and diffusion models generate high-quality samples in many modalities; however, many network evaluations are required during inference due to numerical integration of an underlying differential equation.

By Sam McCallum, Zander W. Blasingame, Timothy Herschell, Niklas Rindtorff, Alexander Tong, James Foster