A Single Architecture for Representing Invariance Under Any Space Group
Cindy Zhang, Elif Ertekin, Peter Orbanz, Ryan P Adams
摘要
Incorporating known symmetries in data into machine learning models has consistently improved predictive accuracy, robustness, and generalization. However, achieving exact invariance to specific symmetries typically requires designing bespoke architectures for each group of symmetries, limiting scalability and preventing knowledge transfer across related symmetries. In the case of the space groups-symmetries critical to modeling crystalline solids in materials science and condensed matter physics-this challenge is particularly salient as there are 230 such groups in three dimensions. In this work we present a new approach to such crystallographic symmetries by developing a single machine learning architecture that is capable of adapting its weights automatically to enforce invariance to any input space group. Our approach is based on constructing symmetry-adapted Fourier bases through an explicit characterization of constraints that group operations impose on Fourier coefficients. Encoding these constraints into a neural network layer enables weight sharing across different space groups, allowing the model to leverage structural similarities between groups and overcome data sparsity when limited measurements are available for specific groups. We demonstrate the effectiveness of this approach in achieving competitive performance on material property prediction tasks and performing zero-shot learning to generalize to unseen groups.
问问这篇 Paper
智能体会读完全文。
Lune 把这篇 Paper 索引到了每一个公式,引用它的顶会 Paper 也一样。你提问,回答直接引用原文。
它引用的顶会 Paper12
- E(n) Equivariant Graph Neural NetworksVictor Garcia Satorras, Emiel Hoogeboom, Max WellingICML 2021 · 被引用 1,432 次
- Learning from Protein Structure with Geometric Vector PerceptronsBowen Jing, Stephan Eismann, Patricia Suriana, Raphael John Lamarre Townshend 等ICLR 2021 · 被引用 627 次
- Generalizing Convolutional Neural Networks for Equivariance to Lie Groups on Arbitrary Continuous DataMarc Finzi, Samuel Stanton, Pavel Izmailov, Andrew Gordon WilsonICML 2020 · 被引用 372 次
- Periodic Graph Transformers for Crystal Material Property PredictionKeqiang Yan, Yi Liu, Yuchao Lin, Shuiwang JiNeurIPS 2022 · 被引用 167 次
- A new perspective on building efficient and expressive 3D equivariant graph neural networksWeitao Du, Yuanqi Du, Limei Wang, Dieqiao Feng 等NeurIPS 2023 · 被引用 80 次
相关 Paper
- Equivariant Networks for Crystal StructuresSékou-Oumar Kaba, Siamak RavanbakhshNeurIPS 2022 · 被引用 38 次
- MatrixNet: Learning over symmetry groups using learned group representationsLucas Laird, Circe Hsu, Asilata Bapat, Robin WaltersNeurIPS 2024 · 被引用 2 次
- Robust and Interpretable Adaptation of Equivariant Materials Foundation Models via Sparsity-promoting Fine-tuningYoungwoo Cho, Seunghoon Yi, Wooil Yang, Sungmo Kang 等ICLR 2026
- Smooth, exact rotational symmetrization for deep learning on point cloudsSergey Pozdnyakov, Michele CeriottiNeurIPS 2023 · 被引用 68 次
- LieGG: Studying Learned Lie Group GeneratorsArtem Moskalev, Anna Sepliarskaia, Ivan Sosnovik, Arnold W. M. SmeuldersNeurIPS 2022 · 被引用 39 次
