MatrixNet: Learning over symmetry groups using learned group representations
Lucas Laird, Circe Hsu, Asilata Bapat, Robin Walters
Abstract
Group theory has been used in machine learning to provide a theoretically grounded approach for incorporating known symmetry transformations in tasks from robotics to protein modeling. In these applications, equivariant neural networks use known symmetry groups with predefined representations to learn over geometric input data. We propose MatrixNet, a neural network architecture that learns matrix representations of group element inputs instead of using predefined representations. MatrixNet achieves higher sample efficiency and generalization over several standard baselines in prediction tasks over the several finite groups and the Artin braid group. We also show that MatrixNet respects group relations allowing generalization to group elements of greater word length than in the training set.
Ask about this paper
Your agent reads all of it.
Lune indexed this paper to the last equation, along with the top-tier papers that cite it. Ask a question and the answer quotes them.
Cited by top-tier papers1
Ask how each one uses itBuilds on13
- An Image is Worth 16x16 Words: Transformers for Image Recognition at ScaleAlexey Dosovitskiy, Lucas Beyer, Alexander Kolesnikov, Dirk Weissenborn et al.ICLR 2021 · 21,477 citations
- Contrastive Learning of Structured World ModelsThomas N. Kipf, Elise van der Pol, Max WellingICLR 2020 · 322 citations
- Automatic Symmetry Discovery with Lie Algebra Convolutional NetworkNima Dehmamy, Robin Walters, Yanchen Liu, Dashun Wang et al.NeurIPS 2021 · 120 citations
- Implicit-PDF: Non-Parametric Representation of Probability Distributions on the Rotation ManifoldKieran A. Murphy, Carlos Esteves, Varun Jampani, Srikumar Ramalingam et al.ICML 2021 · 93 citations
- Learning Symmetric Embeddings for Equivariant World ModelsJung Yeon Park, Ondrej Biza, Linfeng Zhao, Jan-Willem van de Meent et al.ICML 2022 · 56 citations
Related papers
- A Practical Method for Constructing Equivariant Multilayer Perceptrons for Arbitrary Matrix GroupsMarc Finzi, Max Welling, Andrew Gordon WilsonICML 2021 · 226 citations
- Approximation-Generalization Trade-offs under (Approximate) Group EquivarianceMircea Petrache, Shubhendu TrivediNeurIPS 2023 · 54 citations
- Discovering Group Structures via Unitary Representation LearningDongsung HuhICLR 2025
- Unsupervised Learning of Group Invariant and Equivariant RepresentationsRobin Winter, Marco Bertolini, Tuan Le, Frank Noé et al.NeurIPS 2022 · 61 citations
- Compact Matrix Quantum Group Equivariant Neural NetworksEdward Pearce-CrumpICML 2025
