A Single Architecture for Representing Invariance Under Any Space Group
Cindy Zhang, Elif Ertekin, Peter Orbanz, Ryan P Adams
Abstract
Incorporating known symmetries in data into machine learning models has consistently improved predictive accuracy, robustness, and generalization. However, achieving exact invariance to specific symmetries typically requires designing bespoke architectures for each group of symmetries, limiting scalability and preventing knowledge transfer across related symmetries. In the case of the space groups-symmetries critical to modeling crystalline solids in materials science and condensed matter physics-this challenge is particularly salient as there are 230 such groups in three dimensions. In this work we present a new approach to such crystallographic symmetries by developing a single machine learning architecture that is capable of adapting its weights automatically to enforce invariance to any input space group. Our approach is based on constructing symmetry-adapted Fourier bases through an explicit characterization of constraints that group operations impose on Fourier coefficients. Encoding these constraints into a neural network layer enables weight sharing across different space groups, allowing the model to leverage structural similarities between groups and overcome data sparsity when limited measurements are available for specific groups. We demonstrate the effectiveness of this approach in achieving competitive performance on material property prediction tasks and performing zero-shot learning to generalize to unseen groups.
Ask about this paper
Your agent reads all of it.
Lune indexed this paper to the last equation, along with the top-tier papers that cite it. Ask a question and the answer quotes them.
Your agent calls
Luneget_paper_fulltext
Free to start. No credit card required.
Terminal
Install the CLIlune papers fulltext e7e9be28-863b-47d2-87ce-5642b4f387efBuilds on12
- E(n) Equivariant Graph Neural NetworksVictor Garcia Satorras, Emiel Hoogeboom, Max WellingICML 2021 · 1,432 citations
- Learning from Protein Structure with Geometric Vector PerceptronsBowen Jing, Stephan Eismann, Patricia Suriana, Raphael John Lamarre Townshend et al.ICLR 2021 · 627 citations
- Generalizing Convolutional Neural Networks for Equivariance to Lie Groups on Arbitrary Continuous DataMarc Finzi, Samuel Stanton, Pavel Izmailov, Andrew Gordon WilsonICML 2020 · 372 citations
- Periodic Graph Transformers for Crystal Material Property PredictionKeqiang Yan, Yi Liu, Yuchao Lin, Shuiwang JiNeurIPS 2022 · 167 citations
- A new perspective on building efficient and expressive 3D equivariant graph neural networksWeitao Du, Yuanqi Du, Limei Wang, Dieqiao Feng et al.NeurIPS 2023 · 80 citations
Related papers
- Equivariant Networks for Crystal StructuresSékou-Oumar Kaba, Siamak RavanbakhshNeurIPS 2022 · 38 citations
- MatrixNet: Learning over symmetry groups using learned group representationsLucas Laird, Circe Hsu, Asilata Bapat, Robin WaltersNeurIPS 2024 · 2 citations
- Robust and Interpretable Adaptation of Equivariant Materials Foundation Models via Sparsity-promoting Fine-tuningYoungwoo Cho, Seunghoon Yi, Wooil Yang, Sungmo Kang et al.ICLR 2026
- Smooth, exact rotational symmetrization for deep learning on point cloudsSergey Pozdnyakov, Michele CeriottiNeurIPS 2023 · 68 citations
- LieGG: Studying Learned Lie Group GeneratorsArtem Moskalev, Anna Sepliarskaia, Ivan Sosnovik, Arnold W. M. SmeuldersNeurIPS 2022 · 39 citations
