FAENet: Frame Averaging Equivariant GNN for Materials Modeling
Alexandre Duval, Victor Schmidt, Alex Hernández-García, Santiago Miret, Fragkiskos D. Malliaros, Yoshua Bengio, David Rolnick
Abstract
Applications of machine learning techniques for materials modeling typically involve functions known to be equivariant or invariant to specific symmetries. While graph neural networks (GNNs) have proven successful in such tasks, they enforce symmetries via the model architecture, which often reduces their expressivity, scalability and comprehensibility. In this paper, we introduce (1) a flexible framework relying on stochastic frame-averaging (SFA) to make any model E(3)-equivariant or invariant through data transformations. (2) FAENet: a simple, fast and expressive GNN, optimized for SFA, that processes geometric information without any symmetrypreserving design constraints. We prove the validity of our method theoretically and empirically demonstrate its superior accuracy and computational scalability in materials modeling on the OC20 dataset (S2EF, IS2RE) as well as common molecular modeling tasks (QM9, QM7-X). A package implementation is available at https: //faenet.readthedocs.io .
Ask about this paper
Your agent reads all of it.
Lune indexed this paper to the last equation, along with the top-tier papers that cite it. Ask a question and the answer quotes them.
Your agent calls
Luneget_paper_fulltext
Free to start. No credit card required.
Terminal
Install the CLIlune papers fulltext 2613f98a-bd38-473c-b677-b4e719d8ddaeCited by top-tier papers31
- Smooth, exact rotational symmetrization for deep learning on point cloudsSergey Pozdnyakov, Michele CeriottiNeurIPS 2023 · 68 citations
- The Importance of Being Scalable: Improving the Speed and Accuracy of Neural Network Interatomic Potentials Across Chemical DomainsEric Qu, Aditi S. KrishnapriyanNeurIPS 2024 · 63 citations
- A Canonicalization Perspective on Invariant and Equivariant LearningGeorge Ma, Yifei Wang, Derek Lim, Stefanie Jegelka et al.NeurIPS 2024 · 38 citations
- Equivariant Frames and the Impossibility of Continuous CanonicalizationNadav Dym, Hannah Lawrence, Jonathan W. SiegelICML 2024 · 38 citations
- Are High-Degree Representations Really Unnecessary in Equivariant Graph Neural Networks?Jiacheng Cen, Anyi Li, Ning Lin, Yuxiang Ren et al.NeurIPS 2024 · 31 citations
Builds on15
- Do Transformers Really Perform Badly for Graph Representation?Chengxuan Ying, Tianle Cai, Shengjie Luo, Shuxin Zheng et al.NeurIPS 2021 · 1,632 citations
- E(n) Equivariant Graph Neural NetworksVictor Garcia Satorras, Emiel Hoogeboom, Max WellingICML 2021 · 1,432 citations
- Measuring and Relieving the Over-Smoothing Problem for Graph Neural Networks from the Topological ViewDeli Chen, Yankai Lin, Wei Li, Peng Li et al.AAAI 2020 · 1,353 citations
- Directional Message Passing for Molecular GraphsJohannes Klicpera, Janek Groß, Stephan GünnemannICLR 2020 · 1,079 citations
- SE(3)-Transformers: 3D Roto-Translation Equivariant Attention NetworksFabian Fuchs, Daniel E. Worrall, Volker Fischer, Max WellingNeurIPS 2020 · 1,025 citations
Related papers
- Frame Averaging for Invariant and Equivariant Network DesignOmri Puny, Matan Atzmon, Edward J. Smith, Ishan Misra et al.ICLR 2022 · 177 citations
- A new perspective on building efficient and expressive 3D equivariant graph neural networksWeitao Du, Yuanqi Du, Limei Wang, Dieqiao Feng et al.NeurIPS 2023 · 80 citations
- Equivariant Atomic and Lattice Modeling Using Geometric Deep Learning for Crystal Structure OptimizationZiduo Yang, Yiming Zhao, Xian Wang, Wei Zhuo et al.AAAI 2026 · 1 citation
- GotenNet: Rethinking Efficient 3D Equivariant Graph Neural NetworksSarp Aykent, Tian XiaICLR 2025
- DualEqui: A Dual-Space Hierarchical Equivariant Network for Large BiomoleculesJunjie Xu, Jiahao Zhang, Mangal Prakash, Xiang Zhang et al.NeurIPS 2025 · 2 citations
