arXiv Machine Learning

Theoretical Aspects of Lie Groupoid and Lie Algebroid Equivariant Convolutional Neural Networks

arXiv:2606. 02758v1 Announce Type: cross Abstract: We introduce Lie groupoid equivariant neural networks as a specialization of recently proposed topological category-equivariant neural networks to the differentiable setting.

arXiv Machine Learning
Sep 7

The Geometry of Polynomial Group Convolutional Neural Networks

The paper introduces a new mathematical framework for polynomial group convolutional neural networks (PGCNNs) using graded group algebras. It presents two natural parametrizations of the architecture—based on Hadamard and Kronecker products—that are related by a linear map. The authors compute the dimension of the resulting neuromanifold, show it depends only on the number of layers and group size, and describe the general fiber of the Kronecker parametrization, conjecturing a similar description for the Hadamard case, supported by explicit computations for small groups and shallow networks.

By Yacoub Hendi, Daniel Persson, Magdalena Larfors
arXiv Machine Learning
4d ago

Transversal Pooling Neural Networks

arXiv:2609.36237v1 Announce Type: new Abstract: Many learning tasks require stability to small transformations while retaining sensitivity to larger ones. We introduce \emph{transversal pooling neura...

By Emily J. King, Dustin G. Mixon, Michael Perlmutter, Lander Ver Hoef
arXiv Machine Learning
Sep 22

Optimal Symmetries in Binary Classification

arXiv:2408.08823v2 Announce Type: replace Abstract: We develop a theoretical foundation for designing group-equivariant neural networks that align the choice of symmetries with the underlying probabi...

By Vishal S. Ngairangbam, Michael Spannowsky
Hugging Face Trending Papers
Aug 12

Reducing Symmetry Increase in Equivariant Neural Networks

Equivariant Neural Networks (ENNs) have empowered numerous applications in scientific fields. Despite their remarkable capacity for representing geometric structures, ENNs suffer from degraded expressivity when processing symmetric inputs: the output representations are invariant to transformations that extend beyond the input's symmetries.

arXiv AI
Jul 2

Group-Equivariant Poincar\'e Convolutional Networks

arXiv:2607. 00556v1 Announce Type: cross Abstract: While recent advancements like the Poincar\'e ResNet have demonstrated the potential of learning visual representations directly in hyperbolic space, their optimisation remains hampered by the computationally intensive nature of Riemannian gradients and the strict boundaries of the manifold.

By Aiden Durrant, Rahul Baburajan, Georgios Leontidis
Hugging Face Trending Papers
Jul 1

Group-Equivariant Poincaré Convolutional Networks

While recent advancements like the Poincaré ResNet have demonstrated the potential of learning visual representations directly in hyperbolic space, their optimisation remains hampered by the computationally intensive nature of Riemannian gradients and the strict boundaries of the manifold. Furthermore, standard hyperbolic networks treat spatial transformations of the same object as distinct hierarchical concepts, leading to redundant parameter usage and vanishing signals.