arXiv Computer Vision

Mask IPL: Noise-Free Intrinsic Position Learning via Computation Graph Clipping for Event-Based Spike-Driven Tracking

Mask IPL introduces a Computation Graph Clipping technique that removes noise from Intrinsic Position Learning (IPL) in spiking neural networks for event-based tracking. By applying a validity mask to each layer, the method aligns forward and backward propagation with ideal gradients without adding parameters. Experiments show that Mask IPL consistently improves tracking performance on Tiny‑scale and Base‑scale benchmarks such as FE108, FELT, and VisEvent.

arXiv Computer Vision
Sep 23

SBMVTrack: Spike-Budgeted Multi-View Learning for Energy-Efficient UAV Tracking

SBMVTrack is a fully spiking neural network framework designed for energy-efficient UAV visual tracking. It introduces Energy-Weighted Spike Budgeting (EWSB) to constrain spike activity based on computational cost, and Masked Multi-View Target Modeling (MVTM) to enhance target representation by leveraging correlated temporal views. Experiments on multiple benchmarks show that SBMVTrack reduces spike firing rates and theoretical energy consumption while maintaining competitive tracking accuracy.

By Pengzhi Zhong, Jiwei Mo, Haolun Li, Ge Zheng, Jingqi Wang, Xinyi Bo, Shuiwang Li
arXiv Machine Learning
Aug 19

Spikformer V2: Join the High Accuracy Club on ImageNet with an SNN Ticket

Spikformer V2 introduces a Spiking Self‑Attention (SSA) mechanism that removes softmax and uses spike‑based Query, Key, and Value to capture sparse visual features efficiently. It also adds a Spiking Convolutional Stem (SCS) and employs self‑supervised learning (masking and reconstruction) to pre‑train the model before fine‑tuning on ImageNet. The result is the first spiking neural network to surpass 80 % accuracy on ImageNet, achieving 81.10 % with a 172 M‑parameter, 16‑layer model in just one time step.

By Zhaokun Zhou, Yijie Lu, Kaiwei Che, Wei Fang, Keyu Tian, Qihao Peng, Yuesheng Zhu, Shuicheng Yan, Yonghong Tian, Li Yuan
arXiv AI
Jul 15

Burst Spiking Neural Networks

arXiv:2607. 11914v1 Announce Type: cross Abstract: A central goal of current Spiking Neural Network (SNN) research is to improve their accuracy toward becoming low-power alternatives to Artificial Neural Networks (ANNs).

By Jiahong Zhang, Sijun Shen, Man Yao, Han Xu, Mingqiang Huang, Yonghong Tian, Bo Xu, Guoqi Li
arXiv Computer Vision
Aug 27

STATrack: A Target-Aware Fully Spiking Neural Network for Efficient UAV Tracking

STATrack is a fully spiking neural network designed for UAV visual tracking using only RGB inputs, eliminating the need for costly event cameras. It introduces Adaptive Mutual Information Maximization (AMIM) to preserve fine-grained target information in deep spiking representations and a sample-difficulty-aware dynamic weighting strategy to adjust the mutual‑information constraint during training. Experiments on four UAV tracking benchmarks show that STATrack achieves state‑of‑the‑art performance while maintaining low theoretical energy consumption.

By Pengzhi Zhong, Jiwei Mo, Dan Zeng, Feixiang He, Shuiwang Li
arXiv AI
Aug 28

ANTShapes Benchmarking Datasets for Event-Based Neuromorphic Object Classification

The paper introduces four new event‑based vision datasets created with the ANTShapes simulation tool, designed to support object classification research using spiking neural networks (SNNs). These datasets vary in difficulty and are benchmarked against established spiking datasets such as N‑MNIST, CIFAR10‑DVS, DVSGesture, and POKER‑DVS using a convolutional SNN. The work provides detailed, high‑quality datasets for future experiments and validates ANTShapes as a suitable tool for generating event‑based vision data.

By M. Middleton, H. Kayan, B. Sen Bhattacharya, T. Ali, E. Baikas, M. Vousden, C. Perera, O. Rhodes, E. Gheorghiu, M. A. Trefzer
arXiv Computer Vision
2d ago

Vmem-$\varphi$: Low-Compute Out-of-Distribution Detection in Spiking Neural Networks from Membrane-Potential Statistics

arXiv:2610.00350v1 Announce Type: new Abstract: Spiking Neural Networks (SNNs) offer an energy-efficient approach to processing event-camera data, yet out-of-distribution (OOD) detection remains chal...

By Arul Rana, Agrim Tripathi, Shoaib Ahmed Dipu, Md. Shaown Miah, Syed Ishtiaque Ahmed, Sayeed Shafayet Chowdhury