arXiv Machine Learning By Agnese Adorante, Aaron Spieler, Anna Levina

The Computational Value of Sensory-Aligned Receptive Fields Depends on Neuronal Expressivity

Read the original on arXiv Machine Learning →

The study investigates whether sensory-aligned receptive fields provide computational benefits beyond mere resource efficiency in recurrent networks of Expressive Leaky Memory neurons. Across auditory and event-based visual classification tasks, receptive fields aligned with task-relevant sensory coordinates improve test accuracy compared to budget-matched random fields, but this advantage disappears when coordinates are scrambled or irrelevant. The benefit diminishes as neuronal expressivity increases, and generic synaptic sparsity regularization only partially recovers performance, indicating that structured receptive fields act as a computational prior beyond sparsity alone.

Machine-generated by The Flow from the publisher's headline and feed description — not written or checked by a human. The full article lives at arXiv Machine Learning.

arXiv Machine Learning
Aug 20

Beyond receptive fields: sequence-pooled normalization can supply most of a sequence labeler's context

The paper argues that a convolutional sequence labeler’s receptive field is not the sole source of context. When a normalization layer computes statistics across the entire sequence at inference, it creates a sequence‑spanning path that supplies global context, effectively replacing the need for a larger receptive field. Experiments on synthetic labeling tasks, simulated genomes, and real 1000 Genomes haplotypes show that this global summary can match or exceed the performance of larger receptive fields, and that ablating receptive‑field‑enlarging blocks overestimates their importance.

By Qing Tian