arXiv AI

Causal pieces: analysing and improving spiking neural networks piece by piece

arXiv Machine Learning
Sep 11

Polyhedral Geometry of Time-to-First-Spike Neural Networks

The paper investigates the expressivity of time-to-first-spike spiking neural networks, showing that each neuron's firing time can be represented in a maxout-like form with many constrained affine pieces. It formalizes causal regions as polyhedral sets defined by fixed causal spike sequences and derives bounds on the number of such regions for both shallow and multilayer networks. Experiments confirm that spiking networks can produce richer input-space partitions than conventional feedforward ReLU networks.

By Manjot Singh, Guido Mont\'ufar, Gitta Kutyniok
arXiv AI
Sep 16

Equivalence of approximation by networks of single- and multi-spike neurons

The paper demonstrates that for a broad class of spiking neuron models, including the leaky integrate‑and‑fire with subtractive reset, any approximation bound proven for multi‑spike networks can be translated to an equivalent single‑spike network with only a linear change in neuron count, and vice versa. This establishes that single‑spike and multi‑spike neural networks possess identical approximation capabilities for general machine learning tasks. Consequently, existing approximation results for single‑spike networks automatically extend to the multi‑spike case.

By Dominik Dold, Philipp Christian Petersen
arXiv AI
Jun 2

Rare Events, Real Signals: Functional Ensembles as Units of Computation in Deep Spiking Networks

arXiv:2606. 00073v1 Announce Type: cross Abstract: We investigate how internal representations emerge across hierarchical processing systems by introducing a neuroscience-inspired framework for analyzing deep spiking neural networks (SNN) through the lens of functional connectivity.

By Aditi Aravind, Konstantinos Ladakis, Mario Alexios Savaglio, Stelios M. Smirnakis, Maria Papadopouli
arXiv AI
2d ago

SpikeMoE: Brain-Inspired Competitive Routing for Flexible Spiking Mixture-of-Experts

SpikeMoE introduces a spike-based k‑WTA router that uses lateral inhibition and refractory periods to select the top‑K experts based on discrete spike counts, inspired by hippocampal CA1 competition. The framework combines spiking neural network dynamics with mixture‑of‑experts conditional computation and adds a two‑stage missing‑modality module for robust multimodal processing. Experiments on vision, language, and multimodal tasks show that SpikeMoE matches or surpasses ANN baselines while offering energy‑efficient performance.

By Xiaoli Liu, Yujie Liang, Jialin Li, Malu Zhang