arXiv Machine Learning

SYNAPSE: Framework for Neuron Analysis and Perturbation in Sequence Encoding

SYNAPSE is a training‑free framework that probes Transformer models by extracting per‑layer [CLS] representations, ranking neurons with a lightweight linear probe, and applying forward‑hook interventions during inference. It enables controlled, repeatable experiments on internal representations without altering the original model, revealing that task‑relevant information is encoded in broad, overlapping neuron subsets and that small weight or logit manipulations can redirect predictions. The framework highlights functional stability, class‑specific specialization, and complementary vulnerability profiles across domains.

arXiv AI
Oct 28

Spiking Neural Networks Are Harder to Steal: A Benchmark Study of Model Stealing Attacks

The paper investigates whether spiking neural networks (SNNs) are more resistant to model stealing attacks than conventional artificial neural networks (ANNs). By benchmarking four common attacks on MNIST, Fashion‑MNIST, and CIFAR‑10, the authors find that SNNs consistently yield surrogates with 10%–20% lower agreement and 15%–25% lower adversarial transferability compared to ANNs. The authors attribute this resilience to the spike‑based, time‑dependent dynamics of SNNs, which make their decision boundaries harder for ANN‑based surrogates to approximate.

By Ayana Moshruba, Maryam Parsa
arXiv Machine Learning
Oct 22

GLUScope: A Tool for Analyzing GLU Neurons in Transformer Language Models

GLUScope is an open‑source tool designed to analyze neurons in Transformer language models that use GLU‑based activation functions such as SwiGLU. It visualizes the four possible sign combinations—gate and in activation being positive or negative—by providing text examples for each quadrant and indicating their frequency. The resource aims to uncover interpretable behaviors that other tools might miss and is available for researchers to extend with additional models, corpora, or neuron pages.

By Sebastian Gerstner, Leonor Veloso, Hinrich Sch\"utze