arXiv Computer Vision By Pengzhi Zhong, Jiwei Mo, Dan Zeng, Feixiang He, Shuiwang Li

STATrack: A Target-Aware Fully Spiking Neural Network for Efficient UAV Tracking

Read the original on arXiv Computer Vision →

STATrack is a fully spiking neural network designed for UAV visual tracking using only RGB inputs, eliminating the need for costly event cameras. It introduces Adaptive Mutual Information Maximization (AMIM) to preserve fine-grained target information in deep spiking representations and a sample-difficulty-aware dynamic weighting strategy to adjust the mutual‑information constraint during training. Experiments on four UAV tracking benchmarks show that STATrack achieves state‑of‑the‑art performance while maintaining low theoretical energy consumption.

Machine-generated by The Flow from the publisher's headline and feed description — not written or checked by a human. The full article lives at arXiv Computer Vision.

arXiv Computer Vision
Sep 23

SBMVTrack: Spike-Budgeted Multi-View Learning for Energy-Efficient UAV Tracking

SBMVTrack is a fully spiking neural network framework designed for energy-efficient UAV visual tracking. It introduces Energy-Weighted Spike Budgeting (EWSB) to constrain spike activity based on computational cost, and Masked Multi-View Target Modeling (MVTM) to enhance target representation by leveraging correlated temporal views. Experiments on multiple benchmarks show that SBMVTrack reduces spike firing rates and theoretical energy consumption while maintaining competitive tracking accuracy.

By Pengzhi Zhong, Jiwei Mo, Haolun Li, Ge Zheng, Jingqi Wang, Xinyi Bo, Shuiwang Li
arXiv AI
Jul 15

Burst Spiking Neural Networks

arXiv:2607. 11914v1 Announce Type: cross Abstract: A central goal of current Spiking Neural Network (SNN) research is to improve their accuracy toward becoming low-power alternatives to Artificial Neural Networks (ANNs).

By Jiahong Zhang, Sijun Shen, Man Yao, Han Xu, Mingqiang Huang, Yonghong Tian, Bo Xu, Guoqi Li
arXiv AI
Sep 18

REACT: A Fully Spiking State-Space Model for Real-Time Event-Driven Temporal Perception

REACT is a fully spiking state‑space model that processes raw event‑camera data one event at a time, avoiding temporal accumulation and its associated delay. It employs a complex‑valued spiking neuron (C‑SiLIF) whose dynamics are driven by the inter‑event interval, enabling continuous‑time state updates at microsecond resolution. Evaluated on gesture recognition and time‑to‑collision estimation, REACT achieves low latency (4.6 ms) and high accuracy, supports anytime prediction, zero‑shot transfer, and INT8 quantization, dramatically reducing energy consumption.

By Geoffroy Keime, Nicolas Cuperlier, Benoit R. Cottereau
arXiv AI
Aug 28

ANTShapes Benchmarking Datasets for Event-Based Neuromorphic Object Classification

The paper introduces four new event‑based vision datasets created with the ANTShapes simulation tool, designed to support object classification research using spiking neural networks (SNNs). These datasets vary in difficulty and are benchmarked against established spiking datasets such as N‑MNIST, CIFAR10‑DVS, DVSGesture, and POKER‑DVS using a convolutional SNN. The work provides detailed, high‑quality datasets for future experiments and validates ANTShapes as a suitable tool for generating event‑based vision data.

By M. Middleton, H. Kayan, B. Sen Bhattacharya, T. Ali, E. Baikas, M. Vousden, C. Perera, O. Rhodes, E. Gheorghiu, M. A. Trefzer