arXiv AI

Robust Representation Learning for Spiking Neural Networks based on Conditional Information Bottleneck

arXiv AI
Jul 15

Burst Spiking Neural Networks

arXiv:2607. 11914v1 Announce Type: cross Abstract: A central goal of current Spiking Neural Network (SNN) research is to improve their accuracy toward becoming low-power alternatives to Artificial Neural Networks (ANNs).

By Jiahong Zhang, Sijun Shen, Man Yao, Han Xu, Mingqiang Huang, Yonghong Tian, Bo Xu, Guoqi Li
arXiv AI
Aug 17

SAGE: Surrogate-gradient Adaptation via Attention-Guided Entropy for Spiking Transformers

arXiv:2608. 13702v1 Announce Type: cross Abstract: Spiking neural networks (SNNs) offer an energy-efficient alternative to conventional deep neural networks by exploiting sparse event-driven computation, but their training remains challenging because the non-differentiable spike function requires surrogate gradients whose fixed shape may be suboptimal across layers and training stages.

By Kiran Nair, Rodrigue Rizk, KC Santosh
arXiv Computer Vision
Oct 16

The Dormant Spiking Neuron: A State-Driven Mechanism for Efficient Spiking Neural Networks

The paper introduces the Dormant Spiking Neuron (DSN), a state-driven mechanism that allows neurons in spiking neural networks to enter a dormant state when their membrane potential falls below a negative threshold. This dynamic gating prunes redundant computations at the instance level and is trained end‑to‑end via backpropagation through time with surrogate gradients. Experiments on static and neuromorphic datasets, including ImageNet, show that DSN reduces computational energy by 40% to over 70% and improves baseline SNN accuracy by 1.34%, outperforming state‑of‑the‑art static pruning methods.

By Ruichen Ma, Yicai Chen, Pujun Zhou, Yue Zuo, Chongyang Li, Shuang Liu, Shaogang Hu, Guanchao Qiao
arXiv AI
Oct 19

SpikeQ: Spike-Guided Post-Training Quantization for Spiking Neural Networks

SpikeQ introduces a spike‑guided post‑training quantization framework for spiking neural networks, selecting weight levels by simulating downstream neurons to minimize spike errors and designing a reset‑aware grid for pre‑fire membrane potential quantization that avoids spike flips. The method outperforms existing grids on seven image‑processing benchmarks, maintaining full‑precision accuracy with 2‑bit pre‑fire potentials and staying within 2.59 points of full precision at 4 bits while drastically reducing memory and energy usage.

By Kai Sun, Peibo Duan, Zhanglu Yan, Guowei Zhang, Yongsheng Huang, Levin Kuhlmann
arXiv AI
6d ago

Spiking Neural Networks Are Harder to Steal: A Benchmark Study of Model Stealing Attacks

The paper investigates whether spiking neural networks (SNNs) are more resistant to model stealing attacks than conventional artificial neural networks (ANNs). By benchmarking four common attacks on MNIST, Fashion‑MNIST, and CIFAR‑10, the authors find that SNNs consistently yield surrogates with 10%–20% lower agreement and 15%–25% lower adversarial transferability compared to ANNs. The authors attribute this resilience to the spike‑based, time‑dependent dynamics of SNNs, which make their decision boundaries harder for ANN‑based surrogates to approximate.

By Ayana Moshruba, Maryam Parsa
arXiv Machine Learning
Jun 11

A2SG:Adaptive and Asymmetric Surrogate Gradients for Training Deep Spiking Neural Networks

arXiv:2606. 11236v1 Announce Type: cross Abstract: Training deep spiking neural networks (SNNs) remains challenging due to sharp loss landscapes and temporal inconsistency caused by surrogate gradients.

By Yechan Kang, Yongjin Kweon, Mingyeong Seo, Sohee Park, Yeonguk Jeon, Jongkil Park, Hyun Jae Jang, Jaewook Kim, YeonJoo Jeong, Suyoun Lee, Seongsik Park