Towards Data Science

A Neural Network Learned to Read Digits From Pure Noise

The article describes a small NumPy reproduction of subliminal learning, demonstrating how a neural network can learn to read digits from pure noise. It provides a concise implementation and a brief argument explaining why this phenomenon occurs.

Towards Data Science
Oct 28

Building and Visualising Kolmogorov–Arnold Networks

The article "Building and Visualising Kolmogorov–Arnold Networks" explores the concept of neural networks that learn functions rather than just weights. It discusses the construction and visualization of Kolmogorov–Arnold networks, providing insights into how these networks operate and how they can be represented visually. The post was originally published on Towards Data Science.

By Sam Everest
arXiv AI
Jun 2

Paradoxical noise preference in RNNs

arXiv:2601. 04539v2 Announce Type: replace-cross Abstract: In recurrent neural networks (RNNs) used to model biological neural networks, noise is typically introduced during training to emulate biological variability and regularize learning.

By Noah Eckstein, Manoj Srinivasan
arXiv Machine Learning
Jun 15

Neural Variability Enhances Artificial Network Robustness

arXiv:2606. 13801v1 Announce Type: new Abstract: Neural responses in cortex exhibit substantial trial-to-trial variability in response to repeated stimuli, while peripheral sensory neurons respond far more consistently, leading many to wonder whether stochasticity may carry meaning.

By Robin Preble, Praveen Venkatesh, Stefan Mihalas, Kameron Decker Harris
Towards Data Science
Sep 23

I Trained a Tiny Network to Compress Data. It Drew a Pentagon.

The article describes how the author replicated Anthropic’s “Toy Models of Superposition” using only NumPy, hand‑derived gradients, and no external libraries. By training a very small neural network to compress data, the model produced a pentagon shape as its output. The post showcases a minimal, from‑scratch implementation of a complex concept in machine learning.

By Utkarsh Mangal