arXiv Machine Learning By Tiejun Li, Zhaoqi Liu, Xiang Zhou

Iterative Neural Variational Solver of Committor Function in Under-damped Langevin Dynamics

Read the original on arXiv Machine Learning →

The paper introduces an iterative neural variational solver for the committor function in under‑damped Langevin dynamics. By splitting the infinitesimal generator into self‑adjoint and skew‑adjoint parts, each subproblem gains a variational form that can be efficiently solved with neural networks, resembling a generalized Concus‑Golub‑Widlund splitting. The method is validated on benchmark systems such as a double‑well potential, the Muller‑Brown potential, and alanine dipeptide, demonstrating practical accuracy and extensibility for studying rare transition events across different damping coefficients.

Machine-generated by The Flow from the publisher's headline and feed description — not written or checked by a human. The full article lives at arXiv Machine Learning.

arXiv Statistics ML
Sep 25

Global Convergence of Third-Order Langevin Dynamics for Non-Convex Optimization via Simulated Annealing

The paper establishes global convergence guarantees for third‑order Langevin dynamics applied to non‑convex optimization via simulated annealing with fixed friction and decreasing noise. It shows that, under dissipativity, regularity, and low‑temperature functional‑inequality assumptions, a logarithmic cooling schedule drives objective values to the global minimum with a barrier‑controlled kinetic rate, and that polynomially decreasing step sizes preserve this rate for both exact‑force‑integral and midpoint three‑stage discretizations. Numerical experiments on a double‑well problem and high‑dimensional neural‑network objectives demonstrate that third‑order Langevin schemes outperform overdamped Langevin dynamics and, in some cases, the one‑gradient UBU integrator in terms of terminal‑success point estimates and post‑quench test accuracy.

By Yingli Wang, Kelvin Shuangjian Zhang, Lingjiong Zhu
arXiv Machine Learning
Aug 27

Improved Analysis for Hessian-free High-resolution Monte Carlo Sampling

The paper introduces Hessian-free high-resolution (HFHR) dynamics, an extension of underdamped Langevin dynamics that incorporates reversible position diffusion for sampling in machine learning. It provides an explicit quantitative contraction rate under a position Poincaré inequality, weighted Hessian and Laplacian bounds, and a compact Sobolev embedding, even when the potential is non‑convex. For the HFHR Monte Carlo algorithm, a path‑space Girsanov argument yields a non‑asymptotic convergence bound and an explicit iteration complexity in total variation distance, improving on previous HFHR results and demonstrating benefits of a positive diffusion parameter through numerical experiments.

By Wujun Lv, Xiaoyu Wang, Yingli Wang, Lingjiong Zhu