The study investigates whether a neuron's tuning properties can be inferred solely from its correlation matrix with other neurons, without any stimulus information. Using a transformer model on the correlation matrix of 512 neurons from mouse visual cortex, the authors successfully decode preferred orientation with a mean error of 25°, and predict receptive-field position with R² values up to 0.48 on a digital twin. The results show that orientation classes are recoverable due to near-circulant relationships in the correlation structure, and that decoding generalizes across animals only when populations are mixed, highlighting the role of inter-animal diversity.
By Francesco L\"assig
arXiv:2610.35411v1 Announce Type: new
Abstract: We measure the emotion geometry of six LLMs spanning Google's Gemma 2 family. Using an extraction pipeline established by Sofroniew et al. (2026) on Cl...
By Adam Hollowell
The paper introduces the Intersection Euler Characteristic Profile, a topological metric for measuring class overlap in neural representations, and provides exact permutation and sign‑flip tests to assess disentanglement across layers. Using this statistic, the authors analyze 111 networks and 52,650 measurements, finding that disentanglement is depth‑graded, occurs early, and is influenced by training choices such as augmentation and weight decay. The study also demonstrates that the unnormalized mass of the profile predicts test accuracy, while the dimensionless quotient does not outperform simple linear probes.
By Sushovan Majhi
The paper introduces calibrated concept profiles, a method that treats direct neuron readings as measurable quantities. By sampling prompts from a defined distribution and generating two independent batteries, the authors compute a per‑neuron profile expressed in the neuron’s own activation spread, complete with noise units and a minimum resolvable change. The approach is applied to OpenCoder‑1.5B across checkpoints spanning two trillion training tokens, providing unit‑scaled, chance‑level‑aware, and checkpoint‑specific construct attribution for each neuron.
By Piotr Wilam
arXiv:2608. 10251v1 Announce Type: cross Abstract: A transformer's answer lives on one axis: the direction its unembedding reads.
By Mark Oskin
arXiv:2507. 05888v2 Announce Type: replace-cross Abstract: Vernon Mountcastle hypothesized that the basis for intelligence in mammals is the replication of a general computational unit, the cortical column.
By Jeff Hawkins (Thousand Brains Project), Niels Leadholm (Thousand Brains Project), Viviane Clay (Thousand Brains Project)
arXiv:2607. 16741v1 Announce Type: new Abstract: B\"urger et al.
By Francesco Karim Vicidomini
arXiv:2609.01170v1 Announce Type: new
Abstract: Large language models exhibit a modular internal organization that mirrors well-studied functional networks of the human brain, but how this organizati...
By Guangqi Li, Yongxin Li
The paper investigates how many transformer components influence a token prediction by measuring the absolute contribution of each unit and channel to the logit. It finds that thousands of components contribute to a single prediction, yet a small subset—often just dozens—carries the majority of the predictive mass. Across models ranging from 124 M to 7 B parameters, the proportion of the model involved in a prediction remains around one to three percent, independent of size, and the study demonstrates that specific components can be directly read and written to modify model behavior without additional training.
By Mark Oskin
arXiv:2609.08561v1 Announce Type: new
Abstract: Class disentanglement (the separation of a representation's class-conditional point clouds along depth and over training) is usually read off descripti...
By Sushovan Majhi
The paper argues that finite brains generalize to arbitrarily long inputs by using spatial memory that grows with input size while the learner’s observations remain finite. It proposes that this memory is structured as cycles—grid modules, place cells, and hippocampal indices—controlled by a prefrontal system that never directly observes the cycles. Experiments show a neural network trained on strings up to 40 symbols achieves high accuracy on longer sequences, outperforming LSTMs and Transformers on several benchmarks and correctly reversing strings up to 15,015 symbols.
By Yuhang He, Si Wu
arXiv:2603.15412v2 Announce Type: replace
Abstract: The mammalian brain, most extensively studied in rodents and bats, solves an enormous variety of non-spatial cognitive tasks using neural circuitry...
By Xin Li