arXiv Machine Learning

Capturing Membrane Dynamics and Spike Timing of Human Neurons at Scale using Neural Operators

The paper introduces a neural-operator framework that learns a shared operator across multiple neurons of the same cell type, conditioned on biologically interpretable electrophysiological features. This approach scales biophysically realistic neuron models to large populations while preserving rich cellular dynamics and within-cell-type variability. Evaluation shows accurate reproduction of subthreshold membrane dynamics, spike waveforms, firing-rate responses, and spike timing across major cortical inhibitory neuron types, with predicted electrophysiological feature distributions closely matching detailed simulations and human recordings.

arXiv AI
Oct 2

SpikeMoE: Brain-Inspired Competitive Routing for Flexible Spiking Mixture-of-Experts

SpikeMoE introduces a spike-based k‑WTA router that uses lateral inhibition and refractory periods to select the top‑K experts based on discrete spike counts, inspired by hippocampal CA1 competition. The framework combines spiking neural network dynamics with mixture‑of‑experts conditional computation and adds a two‑stage missing‑modality module for robust multimodal processing. Experiments on vision, language, and multimodal tasks show that SpikeMoE matches or surpasses ANN baselines while offering energy‑efficient performance.

By Xiaoli Liu, Yujie Liang, Jialin Li, Malu Zhang
arXiv Machine Learning
Sep 22

A discrete generative model of neuronal spiking activity on microelectrode arrays

The paper presents a discrete generative model for neuronal spiking activity recorded on microelectrode arrays. It uses a shared vocabulary of spatiotemporal motifs learned by a residual vector‑quantized autoencoder and predicts motif occurrence with a factorized masked transformer. Evaluated on 31 assays from human brain organoids and ex vivo hippocampal tissue, the model achieves superior reconstruction and generation performance compared to baselines and shows that motifs are largely reused across assays.

By Md Sayed Tanveer, Mohammed A. Mostajo-Radji, Ge Wang
arXiv AI
Oct 12

NeuronSpark: Selective Spiking State Space Models with Adaptive Computation for Language Modeling

NeuronSpark is a self‑attention‑free language model that uses input‑dependent spiking membrane dynamics, allowing each neuron’s decay rate, gain, and firing threshold to adapt to the current token. This selective spiking approach enables billion‑parameter pretraining from random initialization without relying on backbone transfer, conversion, or distillation, achieving competitive zero‑shot performance and a fast–slow hierarchy. On a 1.1B‑parameter, 2.1B‑token training run, NeuronSpark attains a 40.0 eight‑task zero‑shot average, surpasses comparable‑budget Pythia/Mamba checkpoints, and demonstrates significant energy and cycle reductions on FPGA implementations.

By Zhengzheng Tang
arXiv Machine Learning
Sep 15

Exploring napping paradigm for Recurrent Spiking Neural Networks

The paper proposes a biologically inspired micro‑sleep technique called napping for recurrent spiking neural networks, combining proportional weight scaling with continuous stochastic membrane activity. Experiments on an unsupervised SNN trained with trace‑based STDP on Gabor‑preprocessed MNIST show that well‑tuned napping can match the classification accuracy of conventional weight normalization while offering different clustering characteristics. The study suggests that napping may be preferable when representational structure is more important than raw classification speed, despite its higher simulation cost.

By Andreas Massey, Stefano Nichele, Aliaksandr Hubin
arXiv Machine Learning
Jun 11

A2SG:Adaptive and Asymmetric Surrogate Gradients for Training Deep Spiking Neural Networks

arXiv:2606. 11236v1 Announce Type: cross Abstract: Training deep spiking neural networks (SNNs) remains challenging due to sharp loss landscapes and temporal inconsistency caused by surrogate gradients.

By Yechan Kang, Yongjin Kweon, Mingyeong Seo, Sohee Park, Yeonguk Jeon, Jongkil Park, Hyun Jae Jang, Jaewook Kim, YeonJoo Jeong, Suyoun Lee, Seongsik Park
arXiv AI
Oct 9

SpikeSSL: A Universal Spike Inference Framework with Dynamics-Informed State-Space Layers

SpikeSSL is a universal spike inference framework that uses bidirectional IIR state‑space layers inspired by calcium dynamics as its temporal backbone. It incorporates a multi‑modal conditioning encoder to adapt to different calcium indicators, sampling rates, and trace statistics, and provides per‑frame uncertainty estimates. On a benchmark of 33 public datasets, SpikeSSL achieves state‑of‑the‑art performance both in‑domain and in zero‑shot leave‑one‑indicator‑out settings, and a biophysical simulation pipeline further improves cross‑indicator generalization.

By Chenghao Yue, Siming Xing, Shuran Liu, Angran Li, Yuanlong Zhang