arXiv AI
Jul 28
Sign-Symmetry Learning Rules are Robust Fine-Tuners
arXiv:2502. 05925v2 Announce Type: replace-cross Abstract: Backpropagation (BP) has long been the predominant method for training neural networks due to its effectiveness.
Learning in Deep Networks under Dale's Constraint
arXiv:2608. 06963v1 Announce Type: new Abstract: Biologically plausible learning models aim to explain how neural circuits can implement effective learning under the constraints of real neurons.
Related stories
arXiv Machine Learning
Jul 15
Differentiable Clone-Structured Causal Graphs for End-to-End Cognitive Map Learning from Image Sequences
arXiv:2607. 12382v1 Announce Type: new Abstract: How can an agent build a structured map of its world from nothing but an ongoing sequence of raw sensory input and its own movements, especially when natural variation means exact sensory patterns rarely repeat?
arXiv Machine Learning
Sep 22
Topographic Training Concentrates Causal Circuits Without Improving Neuron Monosemanticity
arXiv:2609.24379v1 Announce Type: cross Abstract: Mechanistic interpretability of vision transformers seeks to decompose model computation into human-readable units, but learned representations entan...
arXiv AI
Jul 21
Emergent Hierarchical Monosemantic Neurons from the Group-Contrastive Forward-Forward Algorithm
arXiv:2607. 16295v1 Announce Type: cross Abstract: Mechanistic interpretability has made significant strides in understanding neural network representations, with sparse dictionary learning (SDL) methods, most prominently sparse autoencoders, as a central paradigm.
Hugging Face Trending Papers
Jul 14
Differentiable Clone-Structured Causal Graphs for End-to-End Cognitive Map Learning from Image Sequences
How can an agent build a structured map of its world from nothing but an ongoing sequence of raw sensory input and its own movements, especially when natural variation means exact sensory patterns rarely repeat? The Clone-Structured Causal Graph algorithm (CSCG), a normative hippocampus model, shows how an interpretable map can be learned from aliased observations.
arXiv AI
Aug 6
NeuMoSync: End-to-End Neuromodulatory Control for Plasticity and Adaptability in Continual Learning
arXiv:2608. 04358v1 Announce Type: new Abstract: Continual learning (CL) requires models to learn tasks sequentially, yet deep neural networks often suffer from plasticity loss and poor knowledge transfer, which can impede their long-term adaptability.
arXiv Machine Learning
Jul 2
Self-Organized Learning in Oscillatory Neural Networks with Memristive Signed Couplings
arXiv:2607. 00286v1 Announce Type: cross Abstract: Oscillatory neural networks (ONNs) have emerged as a promising neuromorphic architecture, leveraging coupled dynamical systems to perform computation and represent information through phase relationships.
arXiv Machine Learning
Jul 1
Diffusing Blame: Task-Dependent Credit Assignment in Biologically Plausible Dual-Stream Networks
arXiv:2606. 31700v1 Announce Type: new Abstract: Biological neural circuits obey Dale's principle: each neuron's synapses are uniformly excitatory or inhibitory.
Hugging Face Trending Papers
Sep 21
Topographic Training Concentrates Causal Circuits Without Improving Neuron Monosemanticity
Mechanistic interpretability of vision transformers seeks to decompose model computation into human-readable units, but learned representations entangle many concepts in each neuron. Feature superposi...
arXiv Machine Learning
Jul 9
Mechanistic Interpretability for Neural Networks: Circuits, Sparse Features and Symbolic Reasoning
arXiv:2607. 07316v1 Announce Type: new Abstract: This article offers a comprehensive overview of mechanistic interpretability, an emerging field that seeks to reverse-engineer the internal algorithms of modern neural networks.
arXiv Machine Learning
Aug 10
Mathematical Principles and Experimental Discoveries of the Emergence of Symbolic Patterns in Artificial Neural Networks
arXiv:2608. 06839v1 Announce Type: new Abstract: Artificial Neural networks (ANNs) are often treated as black-box models, making explainability a central challenge in deep learning.
arXiv AI
2d ago
Forward Target Propagation: A Forward-Only Approach to Global Error Credit Assignment via Local Losses
arXiv:2506.11030v2 Announce Type: replace-cross Abstract: Training neural networks has traditionally relied on backpropagation (BP), a gradient-based algorithm that, despite its widespread success, s...