arXiv Machine Learning

Local Learning Rules for Out-of-Equilibrium Physical Generative Models

arXiv:2506. 19136v4 Announce Type: replace Abstract: We show that the out-of-equilibrium driving protocol of score-based generative models (SGMs) can be learned via local learning rules.

arXiv Machine Learning
Sep 15

Bridging Control, Inference, Transport, and Thermodynamics: From Theory to Applications in Learning

The review explores how control theory, optimal transport, probabilistic inference, non‑equilibrium thermodynamics, and machine learning are interconnected through the optimization of free‑energy‑like functionals under dynamical or statistical constraints. It presents a conceptual thread linking these five fields and illustrates the ideas with applications in reinforcement learning, variational inference, and generative modeling. The article is written for readers without prior familiarity, beginning with physics principles.

By Emmy Blumenthal, Nikolas Claussen, Benjamin Eysenbach, Catherine Ji, Gautam Reddy, Colin Scheibner, Benjamin Sorkin
Hugging Face Trending Papers
Jul 29

Equilibrium Training of Energy-Based Models with Parallel Trajectory Tempering

Energy-Based Models (EBMs) provide an interpretable framework for generative modeling of scientific data, but poor Markov Chain Monte Carlo mixing often limits their reliability. We introduce a training algorithm based on Parallel Trajectory Tempering (PTT), which exploits the continuity of the optimization path to maintain equilibrium sampling throughout learning.

arXiv AI
Jun 2

Equilibrium Propagation for Non-Conservative Systems

arXiv:2602. 03670v2 Announce Type: replace-cross Abstract: Equilibrium Propagation (EP) is a physics-inspired learning algorithm that uses stationary states of a dynamical system both for inference and learning.

By Antonino Emanuele Scurria, Dimitri Vanden Abeele, Bortolo Matteo Mognetti, Serge Massar
arXiv Machine Learning
Aug 19

Nonlinear GENERIC-Embedded Neural Networks (N-GENNs): Learning GENERIC dynamics with non-quadratic dissipation potentials

Nonlinear GENERIC-Embedded Neural Networks (N-GENNs) are a deep learning framework designed to discover evolution equations for systems governed by the nonlinear GENERIC formalism. The method incorporates generalized gradient flows through convex dissipation potentials, allowing it to capture a wider range of thermodynamically consistent dynamics, including those with non‑quadratic dissipation potentials. Thermodynamic structure is enforced by construction, ensuring compliance with the first and second laws, and the approach is validated on a harmonic oscillator with a heat bath, an idealized chemical motor, and a one‑dimensional viscoplastic Perzyna model.

By Vojt\v{e}ch Votruba, Zequn He, Weilun Qiu, Celia Reina, Michal Pavelka
arXiv Machine Learning
Jul 7

Out-of-distribution Neural Inference in Dynamical Ising Models

arXiv:2607. 03039v1 Announce Type: new Abstract: Neural networks are increasingly used to infer hidden physical structure from dynamical observations, yet it remains unclear whether their out-of-distribution performance reflects transferable physical rule learning.

By Yuan-Bin Zhu, Shuang Qiao, Shi-Ju Ran