arXiv Machine Learning

The Metric Slingshot: Navigational Reuse as Width-Optimal Structural Decoupling in Continual Learning

arXiv Machine Learning
Sep 22

Improving the adaptive and continuous learning capabilities of artificial neural networks: Lessons from multi-neuromodulatory dynamics

The paper investigates how multi‑neuromodulatory dynamics—driven by dopamine, acetylcholine, serotonin, and noradrenaline—can improve artificial neural networks’ continuous adaptive learning and mitigate catastrophic forgetting. It demonstrates that neuromodulators interact across multiple spatial and temporal scales, creating a complex many‑to‑many mapping between neuromodulators and tasks. The authors propose neuromodulation‑aware learning rules, architectural formulations, and a conceptual Go/No‑Go study to illustrate how biologically inspired mechanisms can enhance ANN robustness and adaptability.

By Jie Mei, Alejandro Rodriguez-Garcia, Daigo Takeuchi, Gabriel Wainstein, Nina Hubig, Yalda Mohsenzadeh, Srikanth Ramaswamy
arXiv AI
Nov 6

How Finite Brains Generalize Without Bound: Spatial Memory as a Universal Computer

The paper argues that finite brains generalize to arbitrarily long inputs by using spatial memory that grows with input size while the learner’s observations remain finite. It proposes that this memory is structured as cycles—grid modules, place cells, and hippocampal indices—controlled by a prefrontal system that never directly observes the cycles. Experiments show a neural network trained on strings up to 40 symbols achieves high accuracy on longer sequences, outperforming LSTMs and Transformers on several benchmarks and correctly reversing strings up to 15,015 symbols.

By Yuhang He, Si Wu
Hugging Face Trending Papers
Nov 9

Autonomous Continual Learning and Knowledge Transfer via Cortex-Inspired Neural Assemblies

The paper introduces Functional Task Networks (FTNs), a continual learning framework inspired by mammalian neocortex. FTNs use a distributed, stochastic mixture of experts with a sparse binary routing mask that is computed at inference time from a small support set of input-output pairs. This per-batch router reconfiguration, combined with mask-overlap-filtered replay, allows unrelated tasks to use separate assemblies while related tasks share components, achieving strong retention and transfer performance on block‑sequentially trained tasks.