arXiv Machine Learning
6d ago
Reducing Symmetry Increase in Equivariant Neural Networks
arXiv:2608. 12010v1 Announce Type: new Abstract: Equivariant Neural Networks (ENNs) have empowered numerous applications in scientific fields.
Reducing Symmetry Increase in Equivariant Neural Networks
Equivariant Neural Networks (ENNs) have empowered numerous applications in scientific fields. Despite their remarkable capacity for representing geometric structures, ENNs suffer from degraded expressivity when processing symmetric inputs: the output representations are invariant to transformations that extend beyond the input's symmetries.
Related stories
arXiv AI
Jul 7
Foundations of Equivariant Deep Learning: Unifying Graph and Sheaf Neural Networks
arXiv:2607. 03798v1 Announce Type: cross Abstract: Symmetry is everywhere in nature and society.
arXiv Machine Learning
Jul 7
A Complete Symmetry Classification of Shallow ReLU Networks
arXiv:2604. 14037v2 Announce Type: replace Abstract: Parameter space is not function space for neural network architectures.
arXiv Machine Learning
Aug 10
Equivariant Sparse Autoencoders: Mechanistic Interpretability of Neural Networks on Symmetric Data
arXiv:2511. 09432v2 Announce Type: replace Abstract: Machine learning (ML) models achieve remarkable performance but remain hard to interpret due to their scale and complexity.
arXiv Machine Learning
Jun 4
Beyond Structural Symmetries: Linear Mode Connectivity via Neuron Identifiability
arXiv:2606. 04754v1 Announce Type: new Abstract: Many striking phenomena in deep learning, such as linear mode connectivity and the structured behavior of training dynamics, are closely tied to parameter symmetries: transformations that leave the realized function unchanged.
arXiv Machine Learning
Jun 15
Equivariant Representation Learning via Class-Pose Decomposition
arXiv:2207. 03116v4 Announce Type: replace Abstract: We introduce a general method for learning representations that are equivariant to symmetries of data.
arXiv Machine Learning
Jun 10
Conservation Laws from Data Symmetry in Neural Networks
arXiv:2606. 10913v1 Announce Type: new Abstract: We explore whether intrinsic symmetries of the training data lead to conserved quantities during gradient-flow training of neural networks.
arXiv Machine Learning
Jul 7
Observable- and Positional-Encoding-Dependent Symmetry Readout from Neural Network Weights
arXiv:2607. 03108v1 Announce Type: new Abstract: Post-hoc analysis of trained neural network weights often seeks to recover geometric structure directly from the parameters.
arXiv AI
Jun 30
Representation Learning for Equivariant Inference with Guarantees
arXiv:2505. 19809v3 Announce Type: replace-cross Abstract: In many real-world applications of regression, conditional probability estimation, and uncertainty quantification, exploiting symmetries rooted in physics or geometry can dramatically improve generalization and sample efficiency.
arXiv Machine Learning
Jun 5
On Universality of Deep Equivariant Networks
arXiv:2510. 15814v2 Announce Type: replace-cross Abstract: Universality results for equivariant neural networks remain rare.
arXiv AI
Jun 4
SymTRELLIS: Symmetry-Enforced Voxel Latents for 3D Generation
arXiv:2606. 04108v1 Announce Type: cross Abstract: Single-view 3D generative models have achieved impressive visual quality, yet they are not designed to satisfy structural or functional requirements, and in practice, often fall short.
arXiv AI
Aug 3
Revisiting Multi-Permutation Equivariance through the Lens of Irreducible Representations
arXiv:2410. 06665v4 Announce Type: replace-cross Abstract: This paper explores the characterization of equivariant linear layers for representations of permutations and related groups.