arXiv Computer Vision

Spiking Neural Networks for Energy-Efficient Object Detection in Forward-Looking Sonar Imagery

arXiv AI
Aug 28

ANTShapes Benchmarking Datasets for Event-Based Neuromorphic Object Classification

The paper introduces four new event‑based vision datasets created with the ANTShapes simulation tool, designed to support object classification research using spiking neural networks (SNNs). These datasets vary in difficulty and are benchmarked against established spiking datasets such as N‑MNIST, CIFAR10‑DVS, DVSGesture, and POKER‑DVS using a convolutional SNN. The work provides detailed, high‑quality datasets for future experiments and validates ANTShapes as a suitable tool for generating event‑based vision data.

By M. Middleton, H. Kayan, B. Sen Bhattacharya, T. Ali, E. Baikas, M. Vousden, C. Perera, O. Rhodes, E. Gheorghiu, M. A. Trefzer
arXiv AI
Sep 21

LoRA Enhanced Contrastive Learning with SAS Vision Transformers

The paper presents a three‑stage, parameter‑efficient approach to improve automatic target recognition (ATR) with synthetic aperture sonar (SAS) data by adapting DINOv3 Vision Transformers. Stage 1 applies Low‑Rank Adaptation (LoRA) while freezing the backbone, which significantly boosts the area under the precision‑recall curve from 0.300 to 0.679. Subsequent hard‑negative mining and supervised contrastive learning stages show negligible impact, indicating that a single LoRA adaptation is sufficient for effective underwater ATR.

By Dan Zimmerman, Frank E. Bobe III, Amelia L. McCormack, Matthew Cook, Gregory D. Vetaw
arXiv Computer Vision
Aug 27

STATrack: A Target-Aware Fully Spiking Neural Network for Efficient UAV Tracking

STATrack is a fully spiking neural network designed for UAV visual tracking using only RGB inputs, eliminating the need for costly event cameras. It introduces Adaptive Mutual Information Maximization (AMIM) to preserve fine-grained target information in deep spiking representations and a sample-difficulty-aware dynamic weighting strategy to adjust the mutual‑information constraint during training. Experiments on four UAV tracking benchmarks show that STATrack achieves state‑of‑the‑art performance while maintaining low theoretical energy consumption.

By Pengzhi Zhong, Jiwei Mo, Dan Zeng, Feixiang He, Shuiwang Li
arXiv Computer Vision
Oct 5

FUSEye: Training-Light Fisheye Detection with Overlapping Views and Zero-Initialized Adapters

FUSEye is a lightweight training framework that adapts a frozen COCO‑pretrained YOLO26‑x detector for fisheye images by adding only about 227k parameters. It introduces three modules: GridViews to enlarge compressed boundary regions, Z‑Adapters to correct distortion‑induced feature misalignment, and AgreeFusion to fuse detections across overlapping views. On the WoodScape fisheye benchmark, FUSEye boosts YOLO26‑x mAP50 from 0.148 to 0.266 while requiring only 25% of the labeled data to achieve 0.2597 mAP50, and it also improves YOLOv8‑11 detectors.

By Wenya Su, Kai Luo, Di Wen, Ruiping Liu, Yufan Chen, Junwei Zheng, Kunyu Peng, Kailun Yang
arXiv Machine Learning
Aug 19

Spikformer V2: Join the High Accuracy Club on ImageNet with an SNN Ticket

Spikformer V2 introduces a Spiking Self‑Attention (SSA) mechanism that removes softmax and uses spike‑based Query, Key, and Value to capture sparse visual features efficiently. It also adds a Spiking Convolutional Stem (SCS) and employs self‑supervised learning (masking and reconstruction) to pre‑train the model before fine‑tuning on ImageNet. The result is the first spiking neural network to surpass 80 % accuracy on ImageNet, achieving 81.10 % with a 172 M‑parameter, 16‑layer model in just one time step.

By Zhaokun Zhou, Yijie Lu, Kaiwei Che, Wei Fang, Keyu Tian, Qihao Peng, Yuesheng Zhu, Shuicheng Yan, Yonghong Tian, Li Yuan
arXiv Computer Vision
Sep 3

Improved Automatic Target Recognition in Synthetic Aperture Sonar Imagery Using Large Deep Neural Networks

The paper investigates Automatic Target Recognition (ATR) in Synthetic Aperture Sonar (SAS) imagery, comparing modern convolutional neural networks (CNNs) and transformer-based deep neural networks (DNNs). It examines how factors such as network size, architecture, pretraining methods, data augmentation, and regularization influence performance, aiming to identify the highest-performing model and provide a training roadmap for state‑of‑the‑art SAS‑ATR systems.

By C. J. Moore, Alex Hurt, Jordan Malof
arXiv AI
5d ago

SDPAD: A Fully Spike-Driven Pipeline for End-to-End Autonomous Driving

SDPAD is a fully spike‑driven end‑to‑end planning pipeline for autonomous driving that converts a pre‑trained ANN perception stack into integer‑spike form, lifts multi‑view images into a bird’s‑eye‑view space with a spike‑driven depth distribution, and plans via a spiking query transformer that fuses ego, agent, and map queries. On the nuScenes benchmark it matches strong ANN planners with an average L₂ error of 0.40 m and a collision rate of 0.12 %, while consuming only 69.9 mJ—less than 2 % of recent ANN baselines. In closed‑loop NAVSIM evaluation it achieves 86.3 PDMS, surpassing the previous SNN planner SAD by 4.3 points and matching mainstream ANN planners at a fraction of their energy.

By Chengjun Zhang, Yuhao Zhang, Jie Yang, Mohamad Sawan
arXiv AI
Jul 15

Burst Spiking Neural Networks

arXiv:2607. 11914v1 Announce Type: cross Abstract: A central goal of current Spiking Neural Network (SNN) research is to improve their accuracy toward becoming low-power alternatives to Artificial Neural Networks (ANNs).

By Jiahong Zhang, Sijun Shen, Man Yao, Han Xu, Mingqiang Huang, Yonghong Tian, Bo Xu, Guoqi Li
arXiv AI
Jun 24

End-to-End Radar and Communication Modulation Recognition with Neuromorphic Computing

arXiv:2606. 24075v1 Announce Type: cross Abstract: Although deep learning-based methods can achieve high accuracy in automatic modulation recognition (AMR) tasks, their high computational cost makes it difficult to strike a balance between accuracy and power consumption, thereby limiting their application on resource-constrained platforms.

By Xiaohu Li, Chongxiao Qu, Caiyong Lin, Chenxiao Dou, Wei Hua