arXiv:2607. 10430v1 Announce Type: cross Abstract: Dimensionality reduction has proven powerful for identifying neural manifolds, which are low-dimensional structures underlying high-dimensional neural activity.
By Hardik Rajpal, Dan Goodman
FlowGenesis is a framework that lets neural networks self‑organize their architecture during training by adding or removing neurons based on a local statistic called Representation Flux. Neurons with high Flux are split to preserve function, while low‑Flux, low‑activity neurons are pruned. Experiments on image and text classification show that networks starting from different sizes converge to similar neuron counts and performance, and the method also improves continual learning by reducing parameters for new tasks without sacrificing accuracy.
By Maksim A Kazanskii
Training in artificial neural networks can be viewed as a trajectory evolving through a high-dimensional loss landscape. However, the large number of trainable parameters makes the direct analysis of these dynamics challenging.
arXiv:2603. 01568v2 Announce Type: replace Abstract: Efficient coding theory predicts that biological perceptual systems compress sensory input optimally under resource constraints, with the systematic structure of errors reflecting the geometry of that compression.
By Leyla Roksan Caglar, Pedro A. M. Mediano, Baihan Lin
arXiv:2606. 30384v1 Announce Type: new Abstract: Training in artificial neural networks can be viewed as a trajectory evolving through a high-dimensional loss landscape.
By Pedro Jim\'enez-Gonz\'alez, Miguel C. Soriano, Lucas Lacasa
The paper investigates how information-theoretic and geometric compression unfolds over time in recurrent neural networks, specifically discretized LSTMs. It finds that compression is strongest at the final timesteps of many datasets and attributes this to three mechanisms: class separability, temporal stationarity of shared dynamics, and limited representational capacity. Through synthetic and real-world experiments, the authors demonstrate that these factors jointly determine the extent of temporal compression and its role as a regularizer when excess capacity exists, but can harm generalization when it consumes task-relevant memory.
By Nikolaus Kopp, Franz Pernkopf, Bernhard Geiger
arXiv:2610.34015v1 Announce Type: cross
Abstract: Most analyses of neural representations focus on trained endpoints, leaving the process by which internal structure forms comparatively unmeasured. W...
By Sanjukta Krishnagopal
arXiv:2606. 00073v1 Announce Type: cross Abstract: We investigate how internal representations emerge across hierarchical processing systems by introducing a neuroscience-inspired framework for analyzing deep spiking neural networks (SNN) through the lens of functional connectivity.
By Aditi Aravind, Konstantinos Ladakis, Mario Alexios Savaglio, Stelios M. Smirnakis, Maria Papadopouli
arXiv:2606. 02993v1 Announce Type: new Abstract: Understanding how structured internal structure emerges during neural network training is central to the study of deep learning.
By Jianliang He, Leda Wang, Fengzhuo Zhang, Siyu Chen, Zhuoran Yang
arXiv:2606. 28380v1 Announce Type: cross Abstract: The intricate structures of biological neural networks largely emerge during development, guided by a comparatively compressed blueprint encoded in the genome.
By Mani Hamidi, Sina Khajehabdollahi, Charley M. Wu, Emmanouil Giannakakis
arXiv:2609.36081v1 Announce Type: new
Abstract: Representations continually change as a network learns new tasks. We ask whether early representational changes naturally form a geometric structure th...
By Yuantao Deng, Jinnuo Liu, Kaizhen Tan, Yuchen Liu
The paper introduces Latent Drift, a generative forecasting framework that predicts slow-evolving neurodegenerative disease progression by learning changes in a compressed semantic representation rather than full-resolution anatomy. It addresses two failure modes—identity collapse and continuous interpolation trap—by removing pixel-level identity from the prediction target and applying Finite Scalar Quantization to suppress high-frequency nuisance fluctuations. Experiments on longitudinal 3D brain MRI demonstrate that Latent Drift outperforms diffusion and autoregressive transformer baselines in both generative fidelity and clinically relevant metrics.
By Yuxiang Feng, Juncheng Wang, Chao Xu, Wenlong Hou, Huihan Wang, Yijie Qian, Yang Liu, Baigui Sun, Yong Liu, Shujun Wang