arXiv Computer Vision

SpikePose: Lightweight Video Human Pose Estimation

arXiv Computer Vision
Sep 23

SBMVTrack: Spike-Budgeted Multi-View Learning for Energy-Efficient UAV Tracking

SBMVTrack is a fully spiking neural network framework designed for energy-efficient UAV visual tracking. It introduces Energy-Weighted Spike Budgeting (EWSB) to constrain spike activity based on computational cost, and Masked Multi-View Target Modeling (MVTM) to enhance target representation by leveraging correlated temporal views. Experiments on multiple benchmarks show that SBMVTrack reduces spike firing rates and theoretical energy consumption while maintaining competitive tracking accuracy.

By Pengzhi Zhong, Jiwei Mo, Haolun Li, Ge Zheng, Jingqi Wang, Xinyi Bo, Shuiwang Li
arXiv Computation and Language
Oct 1

Spike-driven Vision-Language-Action Model

arXiv:2609.39514v1 Announce Type: new Abstract: Vision-language-action (VLA) models bridge multimodal understanding and robotic control, advancing the dominant paradigm for embodied intelligence. How...

By Shuai Wang, Malu Zhang, Mingquan Liu, Weihui Dai, Dehao Zhang, Jieyuan Zhang, Yimeng Shan, Zijian Zhou, Yang Yang
arXiv Machine Learning
Oct 28

Evaluating Spiking MoveNet Deployability for Near-Future Onboard Spiking Satellite Pose Estimation

The paper evaluates a spiking version of the MoveNet architecture, called S-MoveNet-Lightning, for autonomous spacecraft pose estimation. Using the RAPTOR dataset, it compares the spiking model to the standard MoveNet-Lightning, finding that the spiking version requires on average 2.2 times fewer multiplication and accumulation operations on FPGA platforms with AMD Deep Learning Processor Units. The study highlights balanced advantages in computational resources and architectural settings for spiking U‑Net‑like architectures in embedded, event‑driven space applications.

By Jonathan Courtois, Christophe Marabotto, Benoit Miramond, Alain Pegatoquet
arXiv Computer Vision
Aug 27

STATrack: A Target-Aware Fully Spiking Neural Network for Efficient UAV Tracking

STATrack is a fully spiking neural network designed for UAV visual tracking using only RGB inputs, eliminating the need for costly event cameras. It introduces Adaptive Mutual Information Maximization (AMIM) to preserve fine-grained target information in deep spiking representations and a sample-difficulty-aware dynamic weighting strategy to adjust the mutual‑information constraint during training. Experiments on four UAV tracking benchmarks show that STATrack achieves state‑of‑the‑art performance while maintaining low theoretical energy consumption.

By Pengzhi Zhong, Jiwei Mo, Dan Zeng, Feixiang He, Shuiwang Li