arXiv AI

RACE: Scalable Statistical Estimation of Functional Consistency in LLM Neurons

RACE (Residual Alignment for Consistency Estimation) is a forward‑pass statistical framework that assesses the domain‑wide functional consistency of Transformer neurons. It outperforms gradient‑based point estimates in terms of domain specificity and shows a clear association between selected neurons and target domains through token‑distribution experiments. Importantly, RACE’s computational overhead is two orders of magnitude lower than that of gradient‑based methods, enabling scalable domain‑wide analysis.

arXiv Machine Learning
Oct 22

SYNAPSE: Framework for Neuron Analysis and Perturbation in Sequence Encoding

SYNAPSE is a training‑free framework that probes Transformer models by extracting per‑layer [CLS] representations, ranking neurons with a lightweight linear probe, and applying forward‑hook interventions during inference. It enables controlled, repeatable experiments on internal representations without altering the original model, revealing that task‑relevant information is encoded in broad, overlapping neuron subsets and that small weight or logit manipulations can redirect predictions. The framework highlights functional stability, class‑specific specialization, and complementary vulnerability profiles across domains.

By Jes\'us S\'anchez Ochoa, Enrique Tom\'as Mart\'inez Beltr\'an, Alberto Huertas Celdr\'an
arXiv Machine Learning
4d ago

Capturing Membrane Dynamics and Spike Timing of Human Neurons at Scale using Neural Operators

The paper introduces a neural-operator framework that learns a shared operator across multiple neurons of the same cell type, conditioned on biologically interpretable electrophysiological features. This approach scales biophysically realistic neuron models to large populations while preserving rich cellular dynamics and within-cell-type variability. Evaluation shows accurate reproduction of subthreshold membrane dynamics, spike waveforms, firing-rate responses, and spike timing across major cortical inhibitory neuron types, with predicted electrophysiological feature distributions closely matching detailed simulations and human recordings.

By Luca Ghafourpour, Cindy Zhao, Valentin Duruisseaux, Bahareh Tolooshams, Philip H. Wong, Costas A. Anastassiou, Anima Anandkumar
arXiv Machine Learning
Sep 21

BrainWideBench: Benchmarking large-scale pretraining and across-animal transfer in multi-region neural recordings

BrainWideBench is a benchmark that evaluates across‑animal transfer on multi‑region neural recordings from 139 mice, covering 276 brain regions. It comprises three task suites—behavior decoding, neural activity prediction, and anatomical organization recovery—to test whether learned representations support diverse downstream objectives. The benchmark shows that while pretraining improves performance over single‑session baselines, current methods vary in transfer ability and none perform uniformly well across all suites, highlighting the challenge of developing general‑purpose neural representations.

By Alexandre Andre, Shivashriganesh P. Mahato, Vinam Arora, Keshav Balaji, Divyansha Lachi, Nanda H. Krishna, Jingyun Xiao, Yizi Zhang, Ximeng Mao, Wenrui Ma, Han Yu, International Brain Laboratory, Daniel Birman, Niccol\`o Bonacchi, Gaelle A. Chapuis, Joana A. Catarino, Felicia Davatolhagh, Mayo Faulkner, Laura Freitas-Silva, Fei Hu, Julia M. Huntenburg, Anup Khanal, In\^es Laranjeira, Petrina Lau, Guido T. Meijer, Nathaniel J. Miska, Jean-Paul Noel, Alejandro Pan-Vazquez, Georg Raiser, Cyrille Rossant, Karolina Z. Socha, Anne E. Urai, Miles J. Wells, Steven J. West, Olivier Winter, Blake Richards, Guillaume Lajoie, Cole Hurwitz, Mehdi Azabou, Matthew R. Whiteway, Liam Paninski, Eva L. Dyer
arXiv Machine Learning
Jun 11

A2SG:Adaptive and Asymmetric Surrogate Gradients for Training Deep Spiking Neural Networks

arXiv:2606. 11236v1 Announce Type: cross Abstract: Training deep spiking neural networks (SNNs) remains challenging due to sharp loss landscapes and temporal inconsistency caused by surrogate gradients.

By Yechan Kang, Yongjin Kweon, Mingyeong Seo, Sohee Park, Yeonguk Jeon, Jongkil Park, Hyun Jae Jang, Jaewook Kim, YeonJoo Jeong, Suyoun Lee, Seongsik Park
arXiv AI
Jun 2

Rare Events, Real Signals: Functional Ensembles as Units of Computation in Deep Spiking Networks

arXiv:2606. 00073v1 Announce Type: cross Abstract: We investigate how internal representations emerge across hierarchical processing systems by introducing a neuroscience-inspired framework for analyzing deep spiking neural networks (SNN) through the lens of functional connectivity.

By Aditi Aravind, Konstantinos Ladakis, Mario Alexios Savaglio, Stelios M. Smirnakis, Maria Papadopouli
arXiv AI
Aug 17

SAGE: Surrogate-gradient Adaptation via Attention-Guided Entropy for Spiking Transformers

arXiv:2608. 13702v1 Announce Type: cross Abstract: Spiking neural networks (SNNs) offer an energy-efficient alternative to conventional deep neural networks by exploiting sparse event-driven computation, but their training remains challenging because the non-differentiable spike function requires surrogate gradients whose fixed shape may be suboptimal across layers and training stages.

By Kiran Nair, Rodrigue Rizk, KC Santosh
arXiv Machine Learning
Oct 9

Cross-species representation learning aligns mouse and human neural dynamics and tracks clinical drug efficacy

The study introduces a dual‑rule contrastive learning framework that aligns neural dynamics from mice and humans by learning representations organized by biological state rather than species. It demonstrates that this cross‑species representation can recover conserved sensory‑response structures, differentiate disease phenotypes, and track drug efficacy in epilepsy models. The framework also identifies shared disease‑associated neural dynamics between genetically distinct mouse models and human carriers of 16p11.2 copy‑number variants.

By Marko Tvrdic, Justin Richmond Domingo, Jae Ann Buenaluz, Jydell Ashley Palomo Penollar, Edmayelle Villavicencio Alforja, Jobi Fallaeria Subosa, Gabriel Ocana-Santero