arXiv Machine Learning

A Gradient-based yet Spike-Timing-Dependent Solution to the Feedback Learning Problem in Neural Microcircuits

arXiv Machine Learning
3d ago

Exploring napping paradigm for Recurrent Spiking Neural Networks

The paper proposes a biologically inspired micro‑sleep technique called napping for recurrent spiking neural networks, combining proportional weight scaling with continuous stochastic membrane activity. Experiments on an unsupervised SNN trained with trace‑based STDP on Gabor‑preprocessed MNIST show that well‑tuned napping can match the classification accuracy of conventional weight normalization while offering different clustering characteristics. The study suggests that napping may be preferable when representational structure is more important than raw classification speed, despite its higher simulation cost.

By Andreas Massey, Stefano Nichele, Aliaksandr Hubin
arXiv Machine Learning
Sep 11

Building Supervision into Hebbian Plasticity through Spike Agreement

The paper introduces Supervised Spike Agreement-Dependent Plasticity (Supervised SADP), a gradient‑free Hebbian learning rule that embeds class labels directly into spike‑driven plasticity. SADP trains output neurons with a supervised Hebbian rule and hidden neurons by measuring Cohen’s kappa agreement with the correct‑class output spike train, optionally aggregating over temporal offsets (K‑shift). Across six benchmark and medical imaging datasets, SADP consistently outperforms reward‑modulated STDP, achieving higher accuracy (e.g., 86.46 % on MNIST) and faster training (up to 2.86× speedup).

By Gouri Lakshmi S, Athira Chandrasekharan, Harshit Kumar, Muhammed Sahad E, Bikas C Das, Saptarshi Bej
arXiv Machine Learning
Jul 27

Local Synaptic Rules Can Implement a SIGReg Gradient Without Backpropagation

arXiv:2607. 21622v1 Announce Type: cross Abstract: We prove that two canonical local synaptic learning rules, the potentiation arm of spike-timing-dependent plasticity (STDP$^+$) and homeostatic plasticity (instantiated here via flashlight granule-cell-like neurons), together can implement the exact gradient of a SIGReg-like self-supervised learning objective.

By Martin Andrews
arXiv AI
Aug 17

SAGE: Surrogate-gradient Adaptation via Attention-Guided Entropy for Spiking Transformers

arXiv:2608. 13702v1 Announce Type: cross Abstract: Spiking neural networks (SNNs) offer an energy-efficient alternative to conventional deep neural networks by exploiting sparse event-driven computation, but their training remains challenging because the non-differentiable spike function requires surrogate gradients whose fixed shape may be suboptimal across layers and training stages.

By Kiran Nair, Rodrigue Rizk, KC Santosh