arXiv AI

Understanding Deep Learning via Entropy Space Theory

arXiv AI
Sep 10

Deep belief networks are exact

arXiv:2609.05572v1 Announce Type: new Abstract: We prove that every strictly positive probability distribution on \(\{-1,1\}^n\) is represented exactly by a sigmoid belief network with finite paramet...

By Gleb Smirnov
arXiv Machine Learning
Aug 27

M-Fibration Theory with Applications to Neural Network Compression

The paper introduces a general theoretical framework for fibrations on graphs labeled by a commutative monoid, extending the classic theory of graph fibrations to weighted and algebraically labeled graphs. It also accommodates approximate fibrations and demonstrates how this framework can be used to compress arbitrary neural networks, including CNNs, providing a solid theoretical basis for recent findings on fibration symmetries in geometric deep learning.

By Paolo Boldi