arXiv:2609.26167v1 Announce Type: new
Abstract: Activation-energy pruning -- removing weights whose product of magnitude and cumulative pre-synaptic spike count falls below a threshold -- was establi...
By Joseph Bingham
SpikeMoE introduces a spike-based k‑WTA router that uses lateral inhibition and refractory periods to select the top‑K experts based on discrete spike counts, inspired by hippocampal CA1 competition. The framework combines spiking neural network dynamics with mixture‑of‑experts conditional computation and adds a two‑stage missing‑modality module for robust multimodal processing. Experiments on vision, language, and multimodal tasks show that SpikeMoE matches or surpasses ANN baselines while offering energy‑efficient performance.
By Xiaoli Liu, Yujie Liang, Jialin Li, Malu Zhang
arXiv:2604. 08894v2 Announce Type: replace-cross Abstract: Spiking Neural Networks (SNNs) offer superior energy efficiency over Artificial Neural Networks (ANNs).
By Zecheng Hao, Shenghao Xie, Kang Chen, Wenxuan Liu, Zhaofei Yu, Tiejun Huang
The paper introduces an implicit-perturbation zeroth-order (IPZO) architecture for fine-tuning spiking transformers on in‑memory computing (IMC) accelerators. By generating perturbations only for spike‑activated weight rows and combining them with IMC weighted sums, the design eliminates costly read‑modify‑write operations and reduces the hardware footprint of random number generators. An address‑driven XOR recombination scheme (PGU‑XOR) further mitigates spatial correlations, achieving near‑software accuracy while cutting perturbation energy by up to 50% compared to conventional explicit perturbation methods.
By Tengteng Lei, Prabodh Katti, Rashi Dutt, Houssem Sifaou, Tan Peng, Osvaldo Simeone, Kai Xu, Bipin Rajendran
arXiv:2409. 08290v5 Announce Type: replace-cross Abstract: Spiking Neural Networks (SNNs) promise higher energy efficiency over conventional Quantized Artificial Neural Networks (QNNs) due to their event-driven, spike-based computation.
By Zhanglu Yan, Zhenyu Bai, Kaiwen Tang, Weng-Fai Wong
arXiv:2607. 11914v1 Announce Type: cross Abstract: A central goal of current Spiking Neural Network (SNN) research is to improve their accuracy toward becoming low-power alternatives to Artificial Neural Networks (ANNs).
By Jiahong Zhang, Sijun Shen, Man Yao, Han Xu, Mingqiang Huang, Yonghong Tian, Bo Xu, Guoqi Li