Equivariance via Minimal Frame Averaging for More Symmetries and Efficiency
Yuchao Lin, Jacob Helwig, Shurui Gui, Shuiwang Ji
Abstract
We consider achieving equivariance in machine learning systems via frame averaging. Current frame averaging methods involve a costly sum over large frames or rely on sampling-based approaches that only yield approximate equivariance. Here, we propose Minimal Frame Averaging (MFA), a mathematical framework for constructing provably minimal frames that are exactly equivariant. The general foundations of MFA also allow us to extend frame averaging to more groups than previously considered, including the Lorentz group for describing symmetries in space-time, and the unitary group for complex-valued domains. Results demonstrate the efficiency and effectiveness of encoding symmetries via MFA across a diverse range of tasks, including -body simulation, top tagging in collider physics, and relaxed energy prediction. Our code is available at https://github.com/divelab/MFA.
Ask about this paper
Your agent reads all of it.
Lune indexed this paper to the last equation, along with the top-tier papers that cite it. Ask a question and the answer quotes them.
Your agent calls
Luneget_paper_fulltext
Free to start. No credit card required.
Terminal
Install the CLIlune papers fulltext cfb9cd52-c1e9-46e8-ad35-bd8fe9f06e2aCited by top-tier papers11
- A Canonicalization Perspective on Invariant and Equivariant LearningGeorge Ma, Yifei Wang, Derek Lim, Stefanie Jegelka et al.NeurIPS 2024 · 38 citations
- Lorentz Local Canonicalization: How to make any Network Lorentz-EquivariantJonas Spinner, Luigi Favaro, Peter Lippmann, Sebastian Pitz et al.NeurIPS 2025 · 19 citations
- Achieving Approximate Symmetry Is Exponentially Easier than Exact SymmetryBehrooz Tahmasebi, Melanie WeberICLR 2026 · 8 citations
- Efficient Prediction of SO(3)-Equivariant Hamiltonian Matrices via SO(2) Local FramesHaiyang Yu, Yuchao Lin, Xuan Zhang, Xiaofeng Qian et al.ICML 2026 · 7 citations
- Adaptive Canonicalization with Application to Invariant Anisotropic Geometric NetworksYa-Wei Eileen Lin, Ron LevieICLR 2026 · 4 citations
Builds on41
- E(n) Equivariant Graph Neural NetworksVictor Garcia Satorras, Emiel Hoogeboom, Max WellingICML 2021 · 1,432 citations
- Directional Message Passing for Molecular GraphsJohannes Klicpera, Janek Groß, Stephan GünnemannICLR 2020 · 1,079 citations
- Equivariant Diffusion for Molecule Generation in 3DEmiel Hoogeboom, Victor Garcia Satorras, Clément Vignac, Max WellingICML 2022 · 865 citations
- Equivariant message passing for the prediction of tensorial properties and molecular spectraKristof Schütt, Oliver T. Unke, Michael GasteggerICML 2021 · 736 citations
- GemNet: Universal Directional Graph Neural Networks for MoleculesJohannes Gasteiger, Florian Becker, Stephan GünnemannNeurIPS 2021 · 665 citations
Related papers
- Frame Averaging for Invariant and Equivariant Network DesignOmri Puny, Matan Atzmon, Edward J. Smith, Ishan Misra et al.ICLR 2022 · 177 citations
- Lorentz Group Equivariant Neural Network for Particle PhysicsAlexander Bogatskiy, Brandon M. Anderson, Jan T. Offermann, Marwah Roussi et al.ICML 2020 · 164 citations
- A General Framework for Equivariant Neural Networks on Reductive Lie GroupsIlyes Batatia, Mario Geiger, Jose M. Munoz, Tess E. Smidt et al.NeurIPS 2023 · 28 citations
- Scalars are universal: Equivariant machine learning, structured like classical physicsSoledad Villar, David W. Hogg, Kate Storey-Fisher, Weichi Yao et al.NeurIPS 2021 · 185 citations
- Equivariant Frames and the Impossibility of Continuous CanonicalizationNadav Dym, Hannah Lawrence, Jonathan W. SiegelICML 2024 · 38 citations
