arXiv AI

LiteEvent-AE: Lightweight Autoencoder for Event-Based Vision on Low-Latency Energy-Constrained Edge Devices

arXiv Computer Vision
Sep 14

Adaptive AI: Energy Efficient Multi-exit TinyML on Intelligent Vision Systems at the Edge

The paper presents a novel multi‑exit computational scheme for TinyML on an ultra‑low‑power GAP9 SoC, adding confidence‑based gating points to a MobileNetV2 CNN for ImageNet‑100. By allowing inference to stop early, the approach cuts average MAC operations by 41 % (from 313 MMAC to 185 MMAC), reduces inference time by 29 % (49 ms to 35 ms), and saves 24 % in energy (2.1 mJ to 1.6 mJ per frame) with only a ~1 % drop in accuracy. Compared to a state‑of‑the‑art adaptive CNN on the same hardware, the method more than doubles computational efficiency, raising MAC/cycle from 8.1 to 17.2.

By Luca Crupi, Lorenzo Lamberti, Alessandro Giusti, Daniele Palossi
arXiv Computer Vision
Sep 15

A 25-$\mu$s/inf Event-driven Graph Neural Network Processor with Spatiotemporal Caching and Spline Convolution for Ultra-low-latency AI at the Edge

The paper introduces ETHEREAL, the first accelerator for event-driven graph neural networks (EV‑GNNs) that can handle 640×480 resolution inputs. It achieves this through a neighbor‑parallel spline convolution engine and a 2D/3D‑split memory hierarchy that includes a novel region‑of‑interest spatiotemporal caching mechanism. Measurements show end‑to‑end inference latency of 25.6 µs and energy consumption of 1.7 µJ per event on state‑of‑the‑art workloads.

By Adrian Kneip, Martin Lefebvre, Daniel Gehrig, Victoria Catal\'an Pastor, Davide Scaramuzza, Marian Verhelst, Charlotte Frenkel
arXiv AI
Aug 28

ANTShapes Benchmarking Datasets for Event-Based Neuromorphic Object Classification

The paper introduces four new event‑based vision datasets created with the ANTShapes simulation tool, designed to support object classification research using spiking neural networks (SNNs). These datasets vary in difficulty and are benchmarked against established spiking datasets such as N‑MNIST, CIFAR10‑DVS, DVSGesture, and POKER‑DVS using a convolutional SNN. The work provides detailed, high‑quality datasets for future experiments and validates ANTShapes as a suitable tool for generating event‑based vision data.

By M. Middleton, H. Kayan, B. Sen Bhattacharya, T. Ali, E. Baikas, M. Vousden, C. Perera, O. Rhodes, E. Gheorghiu, M. A. Trefzer
arXiv AI
Jul 28

The SpiNNaker2 chip: a many-core platform for flexible and scalable brain-inspired computing

arXiv:2607. 24396v1 Announce Type: cross Abstract: In deep learning, efficiency gets more and more important to compensate for the ongoing growth in model sizes and applications.

By Stefan Scholze, Johannes Partzsch, Sebastian H\"oppner, Florian Kelber, Andreas Dixius, Marco Stolba, Sirine Arfa, Marc Berthel, Georg Ellguth, Jim Garside, Hector A. Gonzalez, Stephan Hartmann, Thomas Kiel-Hocker, Dongwei Hu, Matthias Jobst, Khaleelulla Khan Nazeer, Tim Langer, Chen Liu, Gengting Liu, Matthias Lohrmann, Mantas Mikaitis, Felix Neum\"arker, Amirhossein Rostami, Stefan Schiefer, Tilo Schubert, Delong Shang, Bernhard Vogginger, Yexin Yan, Steve Furber, Christian Mayr
arXiv Machine Learning
Aug 26

Low-Latency Activation-Regularized Sparse Neural Operators with Distillation Assistance Towards Real-Time Edge-Deployable Virtual Sensing

The paper introduces the Sparse-Activation-ReLU (SAR) layer, a single‑step neural operator that promotes activation sparsity without surrogate‑gradient training and is compatible with event‑based computing. In a trunk‑based NOMAD architecture, SAR improves the combined Latency‑Error‑Energy (LEE) metric by over fivefold compared to Variable Spiking Neuron (VSN) and Leaky Integrate‑and‑Fire (LIF) models. Additional techniques such as synthetic knowledge distillation, a ReLU‑based spiking loss, and graph‑neighbor thresholding further reduce LEE and L2 error on the Heat Exchanger dataset, advancing energy‑efficient virtual sensing for edge deployment.

By William Howes, Farid Ahmed, Syed Bahauddin Alam
arXiv Computer Vision
Aug 28

Parameter Efficient Continual Learning for Sparse Event-Based Transformers

The paper introduces sLoTh, a parameter‑efficient continual learning framework for sparse event‑based vision transformers. sLoTh freezes the backbone and limits plasticity to low‑rank attention updates (seLoRA) and shared neuronal threshold modulation, updating less than 1% of parameters without replay buffers. Experiments on CIFAR‑100, Tiny‑ImageNet, ImageNet‑100, and ImageNet‑R show competitive rehearsal‑free performance across up to 100 tasks while achieving roughly 6.5× lower energy consumption than dense vision transformers.

By Vaishnavi Nagabhushana, Kartikay Agrawal, Ayon Borthakur
Hugging Face Trending Papers
Aug 27

Parameter Efficient Continual Learning for Sparse Event-Based Transformers

The paper introduces sLoTh, a parameter‑efficient continual learning framework for sparse event‑based vision transformers. By freezing the backbone and limiting plasticity to low‑rank attention updates (seLoRA) and shared neuronal threshold modulation, sLoTh adapts to new tasks while updating less than 1% of the parameters and avoiding replay buffers. Experiments on CIFAR‑100, Tiny‑ImageNet, ImageNet‑100, and ImageNet‑R show competitive rehearsal‑free performance across up to 100 tasks and achieve roughly 6.5× lower energy consumption than dense vision transformers.