arXiv Machine Learning

Near-Equilibrium Propagation training in nonlinear wave systems

arXiv:2510. 16084v3 Announce Type: replace Abstract: Backpropagation learning algorithm, the workhorse of modern artificial intelligence, is notoriously difficult to implement in physical neural networks.

arXiv Machine Learning
Aug 19

Nonlinear GENERIC-Embedded Neural Networks (N-GENNs): Learning GENERIC dynamics with non-quadratic dissipation potentials

Nonlinear GENERIC-Embedded Neural Networks (N-GENNs) are a deep learning framework designed to discover evolution equations for systems governed by the nonlinear GENERIC formalism. The method incorporates generalized gradient flows through convex dissipation potentials, allowing it to capture a wider range of thermodynamically consistent dynamics, including those with non‑quadratic dissipation potentials. Thermodynamic structure is enforced by construction, ensuring compliance with the first and second laws, and the approach is validated on a harmonic oscillator with a heat bath, an idealized chemical motor, and a one‑dimensional viscoplastic Perzyna model.

By Vojt\v{e}ch Votruba, Zequn He, Weilun Qiu, Celia Reina, Michal Pavelka
arXiv AI
Jun 2

Equilibrium Propagation for Non-Conservative Systems

arXiv:2602. 03670v2 Announce Type: replace-cross Abstract: Equilibrium Propagation (EP) is a physics-inspired learning algorithm that uses stationary states of a dynamical system both for inference and learning.

By Antonino Emanuele Scurria, Dimitri Vanden Abeele, Bortolo Matteo Mognetti, Serge Massar
arXiv AI
Aug 28

Physics-Informed Stochastic Configuration Machine: A Backpropagation-Free Neural Network with Fast Training for Nonlinear Differential Equations

The paper introduces the Physics-Informed Stochastic Configuration Machine (PI‑SCM), a backpropagation‑free neural network designed for solving nonlinear differential equations. By analytically evaluating local Jacobians, PI‑SCM linearizes the physical loss, enabling optimal weight determination through generalized linear least squares and avoiding iterative nonlinear optimization. The authors present a progressive algorithmic suite—PI‑SC‑I, PI‑SC‑II, and PI‑SC‑III—prove their universal approximation properties, and show through experiments that PI‑SCM achieves high‑fidelity predictions and parameter identification while accelerating training by orders of magnitude compared to standard PINNs.

By Yuehao Song (School of Automation, Central South University, Changsha, China), Zhong Chen (School of Automation, Central South University, Changsha, China), Lihui Cen (School of Automation, Central South University, Changsha, China), Liang Wu (Johns Hopkins University, Baltimore, USA), Kai Zhang (State Key Laboratory of Simulation and Regulation of Water Cycle in River Basin, China Institute of Water Resources and Hydropower Research, Beijing, China)
arXiv Machine Learning
Jun 16

A Conservation Law for Equilibrium Propagation and Coupled Learning

arXiv:2606. 15444v1 Announce Type: cross Abstract: In this paper we show that the physical learning methods known as coupled learning (CL) and equilibrium propagation (EP) conserve a mass-like quantity in the trainable parameters in the continuous-time, small-nudging limit.

By Joshua A. McGinnis, Adam G. Kline, Yoichiro Mori
arXiv Machine Learning
Sep 24

Data-driven discrete-time deep recurrent neural network-based modeling for dissipative systems

The paper introduces DissipNet, a deep discrete‑time recurrent neural network that enforces dissipativity through structural weight constraints and a specialized training algorithm. By design, the network learns dissipative dynamics while maintaining stability, as formally verified using Lyapunov theory. Compared to standard RNNs and Physics‑Informed Neural Networks, DissipNet offers explicit stability guarantees and demonstrates improved performance across several modeling tasks.

By Tuan Luong, Hyungpil Moon