arXiv Machine Learning

Separation Capacity of Scattering Networks on Low-Dimensional Datasets

arXiv:2607. 06048v1 Announce Type: cross Abstract: We aim to identify scattering network architectures that maximize the separation capacity on data with low intrinsic dimension.

arXiv Machine Learning
Jul 1

Separation Capacity of Scattering Networks

arXiv:2606. 30822v1 Announce Type: cross Abstract: In this paper, we attempt to enhance the theoretical understanding of convolutional neural networks (CNNs) as feature extractors in classification tasks by analyzing them through the lens of Cover's function-counting theory.

By Konstantin H\"aberle, Helmut B\"olcskei
arXiv Machine Learning
Jun 5

Separation Power of Equivariant Neural Networks

arXiv:2406. 08966v3 Announce Type: replace Abstract: The separation power of a machine learning model refers to its ability to distinguish between different inputs and is often used as a proxy for its expressivity.

By Marco Pacini, Xiaowen Dong, Bruno Lepri, Gabriele Santin
arXiv AI
Jul 9

On the Principles of Deep Feedforward ReLU Networks

arXiv:2607. 07035v1 Announce Type: cross Abstract: The architecture of deep feedforward neural networks is ubiquitous in deep learning, either as a whole system or as a subnetwork of other architectures, and thus its mechanism is a key ingredient of the black box of neural networks.

By Changcun Huang
Hugging Face Trending Papers
Jun 1

Expressivity of congruence-based architectures for DNNs on positive-definite matrices

This work studies neural architectures for classifying symmetric positive-definite matrices, focusing on congruence-like layers, in which the input matrix is multiplied on the left and right by a (possibly rectangular) weight matrix $W$ and its transpose. Such layers lie at the core of the celebrated SPDNet and have also been employed independently for dimensionality reduction on positive-definite data.