arXiv Machine Learning

Near-Equilibrium Propagation training in nonlinear wave systems

arXiv:2510. 16084v3 Announce Type: replace Abstract: Backpropagation learning algorithm, the workhorse of modern artificial intelligence, is notoriously difficult to implement in physical neural networks.

arXiv Machine Learning
23h ago

Nonlinear GENERIC-Embedded Neural Networks (N-GENNs): Learning GENERIC dynamics with non-quadratic dissipation potentials

arXiv:2605. 09058v2 Announce Type: replace-cross Abstract: We introduce Nonlinear GENERIC-Embedded Neural Networks (N-GENNs), a deep learning framework for discovering evolution equations of systems governed by the nonlinear GENERIC formalism (General Equation for Non-Equilibrium Reversible-Irreversible Coupling).

By Vojt\v{e}ch Votruba, Zequn He, Weilun Qiu, Celia Reina, Michal Pavelka
arXiv AI
Jun 2

Equilibrium Propagation for Non-Conservative Systems

arXiv:2602. 03670v2 Announce Type: replace-cross Abstract: Equilibrium Propagation (EP) is a physics-inspired learning algorithm that uses stationary states of a dynamical system both for inference and learning.

By Antonino Emanuele Scurria, Dimitri Vanden Abeele, Bortolo Matteo Mognetti, Serge Massar
arXiv Machine Learning
Jun 16

A Conservation Law for Equilibrium Propagation and Coupled Learning

arXiv:2606. 15444v1 Announce Type: cross Abstract: In this paper we show that the physical learning methods known as coupled learning (CL) and equilibrium propagation (EP) conserve a mass-like quantity in the trainable parameters in the continuous-time, small-nudging limit.

By Joshua A. McGinnis, Adam G. Kline, Yoichiro Mori
arXiv Machine Learning
Jun 29

Adaptive Momentum and Nonlinear Damping for Neural Network Training

arXiv:2602. 00334v2 Announce Type: replace Abstract: Momentum Stochastic Gradient Descent (mSGD) relies on a fixed momentum coefficient shared across all parameters, failing to account for the heterogeneous structure of modern loss landscapes.

By Aikaterini Karoni, Rajit Rajpal, Benedict Leimkuhler, Gabriel Stoltz
arXiv Machine Learning
Jun 19

Evolutionary Two-Stage Hyperparameter Optimization Strategies for Physics-Informed Neural Networks

arXiv:2606. 20442v1 Announce Type: new Abstract: Physics-Informed Neural Networks (PINNs) solve Partial Differential Equations (PDEs) by embedding physical laws into neural network training.

By Fedor Buzaev (HSE University), Dmitry Efremenko (HSE University), Egor Bugaev (HSE University), Andrei Ermakov (HSE University, AXXX), Denis Derkach (HSE University), Daria Pugacheva (HSE University, AXXX), Fedor Ratnikov (HSE University)