arXiv AI By Seyed Roozbeh Razavi Rohani, Khashayar Khajavi, Wesley Chung, Mandana Samiei, Mo Chen

NeuMoSync: End-to-End Neuromodulatory Control for Plasticity and Adaptability in Continual Learning

Read the original on arXiv AI →

arXiv:2608. 04358v1 Announce Type: new Abstract: Continual learning (CL) requires models to learn tasks sequentially, yet deep neural networks often suffer from plasticity loss and poor knowledge transfer, which can impede their long-term adaptability.

Machine-generated by The Flow from the publisher's headline and feed description — not written or checked by a human. The full article lives at arXiv AI.

arXiv Machine Learning
Sep 22

Improving the adaptive and continuous learning capabilities of artificial neural networks: Lessons from multi-neuromodulatory dynamics

The paper investigates how multi‑neuromodulatory dynamics—driven by dopamine, acetylcholine, serotonin, and noradrenaline—can improve artificial neural networks’ continuous adaptive learning and mitigate catastrophic forgetting. It demonstrates that neuromodulators interact across multiple spatial and temporal scales, creating a complex many‑to‑many mapping between neuromodulators and tasks. The authors propose neuromodulation‑aware learning rules, architectural formulations, and a conceptual Go/No‑Go study to illustrate how biologically inspired mechanisms can enhance ANN robustness and adaptability.

By Jie Mei, Alejandro Rodriguez-Garcia, Daigo Takeuchi, Gabriel Wainstein, Nina Hubig, Yalda Mohsenzadeh, Srikanth Ramaswamy
arXiv Machine Learning
Aug 18

Metaplasticity as adaptive gradient preconditioning for incremental learning

arXiv:2608. 14634v1 Announce Type: new Abstract: Biological intelligence naturally prevents catastrophic forgetting through Complementary Learning Systems (CLS) theory, a macroscopic consolidation process driven at the local level by synaptic metaplasticity: the continuous, history-dependent neuromodulation of individual synapses.

By Isabelle Aguilar, Zayn Andre Zainal, Omid Kavehei
arXiv AI
Jun 24

Fast and Slow Variational Continual Learning

arXiv:2606. 24007v1 Announce Type: cross Abstract: Continual learning remains a major challenge for modern deep networks, partly because commonly used optimizers lack inherent mechanisms for continual adaptation.

By Subarnaduti Paul, Yohan Jung, Mohammad Emtiyaz Khan, Siddharth Swaroop, Thomas M\"ollenhoff, Martin Mundt