Generative Adversarial Symmetry Discovery
Jianke Yang, Robin Walters, Nima Dehmamy, Rose Yu
Abstract
Despite the success of equivariant neural networks in scientific applications, they require knowing the symmetry group a priori. However, it may be difficult to know which symmetry to use as an inductive bias in practice. Enforcing the wrong symmetry could even hurt the performance. In this paper, we propose a framework, LieGAN, to automatically discover equivariances from a dataset using a paradigm akin to generative adversarial training. Specifically, a generator learns a group of transformations applied to the data, which preserve the original distribution and fool the discriminator. LieGAN represents symmetry as interpretable Lie algebra basis and can discover various symmetries such as the rotation group SO(n), restricted Lorentz group SO(1, 3) + in trajectory prediction and top-quark tagging tasks. The learned symmetry can also be readily used in several existing equivariant neural networks to improve accuracy and generalization in prediction. Our code is available at https://github.com/Rose-STL-Lab/LieGAN .
Ask about this paper
Your agent reads all of it.
Lune indexed this paper to the last equation, along with the top-tier papers that cite it. Ask a question and the answer quotes them.
Cited by top-tier papers25
- Learning Layer-wise Equivariances Automatically using GradientsTycho F. A. van der Ouderaa, Alexander Immer, Mark van der WilkNeurIPS 2023 · 28 citations
- Latent Space Symmetry DiscoveryJianke Yang, Nima Dehmamy, Robin Walters, Rose YuICML 2024 · 27 citations
- Discovering Symmetry Breaking in Physical Systems with Relaxed Group ConvolutionRui Wang, Elyssa F. Hofgard, Hang Gao, Robin Walters et al.ICML 2024 · 20 citations
- Learning Infinitesimal Generators of Continuous Symmetries from DataGyeonghoon Ko, Hyunsu Kim, Juho LeeNeurIPS 2024 · 18 citations
- A Generative Model of Symmetry TransformationsJames Urquhart Allingham, Bruno Mlodozeniec, Shreyas Padhy, Javier Antorán et al.NeurIPS 2024 · 16 citations
Builds on11
- E(n) Equivariant Graph Neural NetworksVictor Garcia Satorras, Emiel Hoogeboom, Max WellingICML 2021 · 1,432 citations
- Generalizing Convolutional Neural Networks for Equivariance to Lie Groups on Arbitrary Continuous DataMarc Finzi, Samuel Stanton, Pavel Izmailov, Andrew Gordon WilsonICML 2020 · 372 citations
- A Practical Method for Constructing Equivariant Multilayer Perceptrons for Arbitrary Matrix GroupsMarc Finzi, Max Welling, Andrew Gordon WilsonICML 2021 · 226 citations
- Incorporating Symmetry into Deep Dynamics Models for Improved GeneralizationRui Wang, Robin Walters, Rose YuICLR 2021 · 201 citations
- B-Spline CNNs on Lie groupsErik J. BekkersICLR 2020 · 155 citations
Related papers
- Automatic Symmetry Discovery with Lie Algebra Convolutional NetworkNima Dehmamy, Robin Walters, Yanchen Liu, Dashun Wang et al.NeurIPS 2021 · 120 citations
- A General Framework for Equivariant Neural Networks on Reductive Lie GroupsIlyes Batatia, Mario Geiger, Jose M. Munoz, Tess E. Smidt et al.NeurIPS 2023 · 28 citations
- Symmetry Discovery Beyond Affine TransformationsBen Shaw, Abram Magner, Kevin R. MoonNeurIPS 2024 · 15 citations
- Discovering Symmetry Groups with Flow MatchingYuxuan Chen, Jung Yeon Park, Floor Eijkelboom, Jianke Yang et al.ICML 2026 · 3 citations
- Interpretable Discovery of One-parameter Subgroups: A Modular Framework for Elliptical, Hyperbolic, and Parabolic SymmetriesPavan Karjol, Vivek Kashyap, Rohan Venkatesh Kashyap, Prathosh APICML 2026
