arXiv Machine Learning By Daniel Levine, David van Dijk, Kenneth Kay

AutoHebb: Self-Modifying Neural Networks that Zero-Shot Infer and Continually Learn

Read the original on arXiv Machine Learning →

AutoHebb introduces autonomous Hebbian networks that combine external feedback with internally generated neuromodulatory signals to gate a biologically grounded 3‑factor Hebbian learning rule. These networks, optimized via meta‑learning for fixed weights, demonstrate strong inductive biases and autonomous learning control, enabling zero‑shot inference and continual learning without external optimization. They outperform contemporary models on these tasks and can be reverse‑engineered into explicit algorithms, highlighting the importance of meta‑learning, Hebbian plasticity, and autonomous learning control.

Machine-generated by The Flow from the publisher's headline and feed description — not written or checked by a human. The full article lives at arXiv Machine Learning.

arXiv Machine Learning
Sep 22

Improving the adaptive and continuous learning capabilities of artificial neural networks: Lessons from multi-neuromodulatory dynamics

The paper investigates how multi‑neuromodulatory dynamics—driven by dopamine, acetylcholine, serotonin, and noradrenaline—can improve artificial neural networks’ continuous adaptive learning and mitigate catastrophic forgetting. It demonstrates that neuromodulators interact across multiple spatial and temporal scales, creating a complex many‑to‑many mapping between neuromodulators and tasks. The authors propose neuromodulation‑aware learning rules, architectural formulations, and a conceptual Go/No‑Go study to illustrate how biologically inspired mechanisms can enhance ANN robustness and adaptability.

By Jie Mei, Alejandro Rodriguez-Garcia, Daigo Takeuchi, Gabriel Wainstein, Nina Hubig, Yalda Mohsenzadeh, Srikanth Ramaswamy
arXiv AI
Oct 7

MetaLearnNCA: Few-Shot Offline Meta-Learning via Interacting Neural Cellular Automata

MetaLearnNCA introduces a decentralized few‑shot meta‑learning framework that uses interacting Neural Cellular Automata (NCAs) to adapt to new tasks without backpropagation. The method splits adaptation into an Active‑NCA that performs task inference on a 2D spatial memory grid, and a learned Meta‑NCA that diffuses error residuals locally to update this grid. Experiments show competitive in‑distribution performance (96.12% on Omniglot) and superior out‑of‑distribution transfer on MNIST, KMNIST, and Fashion‑MNIST compared to canonical meta‑learners.

By Etienne Guichard, Stefano Nichele