arXiv AI

Deep Learning Method for Stationary Distribution of Reflected Brownian Motion

arXiv:2607. 08091v1 Announce Type: cross Abstract: The stationary distribution of reflected Brownian motion (RBM) plays an important role in the analysis of high-dimensional stochastic systems, yet closed-form solutions are known only for a few special cases.

arXiv Machine Learning
Aug 19

Nonlocal Transition Kernel for Efficient Learning of Restricted Boltzmann Machines

The paper introduces a new transition kernel for Restricted Boltzmann Machines that operates over the sequence of models used in Deep Tempering. This kernel employs a round‑trip structure, allowing nonlocal moves in a single transition while keeping the RBM sequence unchanged. Experiments demonstrate that it achieves higher sampling quality with fewer transitions than both blocked Gibbs sampling and Deep Tempering, and it stabilizes learning by reducing training failures.

By Kaiji Sekimoto, Muneki Yasuda
arXiv AI
Aug 25

Understanding Diffusion Models via Ratio-Based Function Approximation with SignReLU Networks

The paper presents a theoretical framework for approximating ratio-type functionals that arise in conditional generative modeling, specifically when the target density is expressed as a ratio of two kernel-based marginal densities. It proves that deep neural networks using the SignReLU activation can approximate these ratios with established L^p(Omega) bounds and convergence rates under standard regularity assumptions. Applying the framework to Denoising Diffusion Probabilistic Models, the authors construct a SignReLU-based estimator for the reverse process and derive bounds on the excess Kullback–Leibler risk, decomposing it into approximation and estimation errors to provide generalization guarantees for finite-sample training.

By Luwei Sun, Dongrui Shen, Feng Chuanwen, Jianfe Li, Yulong Zhao, Han Feng
arXiv Machine Learning
Jun 24

Deep numerical schemes for systems of Ergodic BSDEs with applications to regime-switching forward utilities

arXiv:2606. 24271v1 Announce Type: cross Abstract: In this paper, we introduce two neural-network-based numerical schemes for solving systems of coupled ergodic Backward Stochastic Differential Equations (eBSDEs), motivated by the approximation of optimal strategies within the framework of forward utilities in a regime-switching stochastic factor model.

By Guillaume Broux-Quemerais (LMM), Sarah Kaakai (LAGA), Anis Matoussi (LMM), Wissal Sabbagh (LMM)