arXiv AI By Bijaya Dangol

Untrainable elements determine what physical learning remembers

Read the original on arXiv AI →

The paper investigates how two independent inductive biases—one from the circuit’s invariance under conductance rescaling and one from the learning rule’s conservation of a mass quantity—affect what a physical learning system remembers. By separating these effects, the authors show that when every element is trainable, the initialization scale has negligible influence on the learned function, whereas a single untrainable element can cause the function to shift significantly with initialization. They further demonstrate that the conservation law does not protect memory but instead influences solution quality, with adjoint coupled learning (AL) generally performing worse than equilibrium propagation (EP) and coupled learning (CL) in small circuits. whyItMatters":"The study clarifies that only the circuit’s structural bias, not the rule’s conservation property, determines memory retention in physical learning systems."

Machine-generated by The Flow from the publisher's headline and feed description — not written or checked by a human. The full article lives at arXiv AI.

arXiv Machine Learning
Jun 16

A Conservation Law for Equilibrium Propagation and Coupled Learning

arXiv:2606. 15444v1 Announce Type: cross Abstract: In this paper we show that the physical learning methods known as coupled learning (CL) and equilibrium propagation (EP) conserve a mass-like quantity in the trainable parameters in the continuous-time, small-nudging limit.

By Joshua A. McGinnis, Adam G. Kline, Yoichiro Mori