arXiv Machine Learning

Nonlocal Transition Kernel for Efficient Learning of Restricted Boltzmann Machines

The paper introduces a new transition kernel for Restricted Boltzmann Machines that operates over the sequence of models used in Deep Tempering. This kernel employs a round‑trip structure, allowing nonlocal moves in a single transition while keeping the RBM sequence unchanged. Experiments demonstrate that it achieves higher sampling quality with fewer transitions than both blocked Gibbs sampling and Deep Tempering, and it stabilizes learning by reducing training failures.

arXiv Machine Learning
Sep 16

Training Energy-Based Models with Non-MCMC Samplers and Efficient Temperature Estimation

The paper introduces Langevin simulated bifurcation (LSB), a fast, parallel Boltzmann sampler that matches the accuracy of sequential MCMC methods. It also proposes conditional expectation matching (CEM), an efficient technique for estimating the effective temperature of samples from energy‑based models with conditional independence. Building on these, the authors develop sampler adaptive learning (SAL), which adjusts the model temperature to align with the distribution produced by LSB, enabling efficient training of semi‑restricted Boltzmann machines (SRBMs) and outperforming conventional methods on synthetic spin‑glass datasets.

By Kentaro Kubo, Hayato Goto
Hugging Face Trending Papers
Jul 29

Equilibrium Training of Energy-Based Models with Parallel Trajectory Tempering

Energy-Based Models (EBMs) provide an interpretable framework for generative modeling of scientific data, but poor Markov Chain Monte Carlo mixing often limits their reliability. We introduce a training algorithm based on Parallel Trajectory Tempering (PTT), which exploits the continuity of the optimization path to maintain equilibrium sampling throughout learning.

arXiv AI
Jun 26

Autoregressive Boltzmann Generators

arXiv:2606. 27361v1 Announce Type: cross Abstract: Efficient sampling of molecular systems at thermodynamic equilibrium is a hallmark challenge in statistical physics.

By Danyal Rehman, Charlie B. Tan, Yoshua Bengio, Avishek Joey Bose, Alexander Tong
arXiv Machine Learning
Sep 18

Correlation-Free Transition Path Sampling through Shooting Point Generation Guided by Committor Learning

The paper introduces GenAIMMD, an iterative algorithm that learns the committor function and trains a conditioned Boltzmann Generator to generate uncorrelated transition paths without prior knowledge of the reaction coordinate. This method combines transition path sampling with committor learning, enabling fully parallelizable sampling. Benchmarks on a toy model and a polymer system show a substantial performance improvement over standard TPS.

By Maximilian Negedly, Sebastian Falkner, Alessandro Coretti, Christoph Dellago
Hugging Face Trending Papers
Jun 25

Autoregressive Boltzmann Generators

Efficient sampling of molecular systems at thermodynamic equilibrium is a hallmark challenge in statistical physics. This challenge has driven the development of Boltzmann Generators (BGs), which allow rapid generation of uncorrelated equilibrium samples by combining a generative model with exact likelihoods and an importance sampling correction.

arXiv AI
Jul 2

Scaling Up Thermodynamic AI Models

arXiv:2607. 00170v1 Announce Type: cross Abstract: Thermodynamic computing devices based on the Ising model show great promise for low-power AI inference and edge computing, but scalable methods for training large models for such hardware remain limited.

By Andrew G. Moore
arXiv Machine Learning
Sep 25

Neural Transport Nested Sampling

Neural Transport Nested Sampling (NTNS) is a new sampling algorithm that merges nested sampling with neural flow-based methods to sample from Boltzmann distributions of molecular systems. It employs a flow-matching velocity as the drift in a Metropolis–Hastings corrected Langevin kernel within a nested sampling loop, requiring only target energy evaluations and enabling scalable estimation of the full partition function for high-dimensional particle systems. Benchmarks on Lennard–Jones clusters up to 55 particles show NTNS reduces interatomic distance and energy Wasserstein errors by more than an order of magnitude compared to leading neural baselines, while also providing a calibrated, temperature-resolved partition function estimate that captures phase structure from a single run.

By David Yallup, Will Handley