arXiv Machine Learning

Improving the adaptive and continuous learning capabilities of artificial neural networks: Lessons from multi-neuromodulatory dynamics

The paper investigates how multi‑neuromodulatory dynamics—driven by dopamine, acetylcholine, serotonin, and noradrenaline—can improve artificial neural networks’ continuous adaptive learning and mitigate catastrophic forgetting. It demonstrates that neuromodulators interact across multiple spatial and temporal scales, creating a complex many‑to‑many mapping between neuromodulators and tasks. The authors propose neuromodulation‑aware learning rules, architectural formulations, and a conceptual Go/No‑Go study to illustrate how biologically inspired mechanisms can enhance ANN robustness and adaptability.

arXiv Machine Learning
Aug 18

Metaplasticity as adaptive gradient preconditioning for incremental learning

arXiv:2608. 14634v1 Announce Type: new Abstract: Biological intelligence naturally prevents catastrophic forgetting through Complementary Learning Systems (CLS) theory, a macroscopic consolidation process driven at the local level by synaptic metaplasticity: the continuous, history-dependent neuromodulation of individual synapses.

By Isabelle Aguilar, Zayn Andre Zainal, Omid Kavehei
arXiv Machine Learning
Nov 2

AutoHebb: Self-Modifying Neural Networks that Zero-Shot Infer and Continually Learn

AutoHebb introduces autonomous Hebbian networks that combine external feedback with internally generated neuromodulatory signals to gate a biologically grounded 3‑factor Hebbian learning rule. These networks, optimized via meta‑learning for fixed weights, demonstrate strong inductive biases and autonomous learning control, enabling zero‑shot inference and continual learning without external optimization. They outperform contemporary models on these tasks and can be reverse‑engineered into explicit algorithms, highlighting the importance of meta‑learning, Hebbian plasticity, and autonomous learning control.

By Daniel Levine, David van Dijk, Kenneth Kay
arXiv AI
1d ago

A Variational Latent Equilibrium for Learning in Neuronal Circuits

The paper proposes a biologically plausible framework to approximate backpropagation through time (BPTT) for learning complex temporal dependencies in neuronal circuits. It derives a time‑continuous equivalent of BPTT using a prospective energy function and introduces a learning rule for backward weights that ensures fully local space‑time dynamics, correcting gain errors inherent in previous approximations. This approach unifies and extends prior local, phase‑free credit assignment methods, offering a rigorous basis for spatiotemporal deep learning in the brain and guiding the design of physical circuits that implement these computations.

By Simon Brandt, Paul Haider, Walter Senn, Federico Benitez, Mihai A. Petrovici