SE(3) Equivariant Graph Neural Networks with Complete Local Frames
Weitao Du, He Zhang, Yuanqi Du, Qi Meng, Wei Chen, Nanning Zheng, Bin Shao, Tie-Yan Liu
Abstract
Group equivariance (e.g. SE(3) equivariance) is a critical physical symmetry in science, from classical and quantum physics to computational biology. It enables robust and accurate prediction under arbitrary reference transformations. In light of this, great efforts have been put on encoding this symmetry into deep neural networks, which has been shown to improve the generalization performance and data efficiency for downstream tasks. Constructing an equivariant neural network generally brings high computational costs to ensure expressiveness. Therefore, how to better trade-off the expressiveness and computational efficiency plays a core role in the design of the equivariant deep learning models. In this paper, we propose a framework to construct SE(3) equivariant graph neural networks that can approximate the geometric quantities efficiently. Inspired by differential geometry and physics, we introduce equivariant local complete frames to graph neural networks, such that tensor information at given orders can be projected onto the frames. The local frame is constructed to form an orthonormal basis that avoids direction degeneration and ensure completeness. Since the frames are built only by cross product operations, our method is computationally efficient. We evaluate our method on two tasks: Newton mechanics modeling and equilibrium molecule conformation generation. Extensive experimental results demonstrate that our model achieves the best or competitive performance in two types of datasets (Code will be released soon).
Ask about this paper
Your agent reads all of it.
Lune indexed this paper to the last equation, along with the top-tier papers that cite it. Ask a question and the answer quotes them.
Cited by top-tier papers36
- Equivariance with Learned Canonicalization FunctionsSékou-Oumar Kaba, Arnab Kumar Mondal, Yan Zhang, Yoshua Bengio et al.ICML 2023 · 109 citations
- A new perspective on building efficient and expressive 3D equivariant graph neural networksWeitao Du, Yuanqi Du, Limei Wang, Dieqiao Feng et al.NeurIPS 2023 · 80 citations
- Understanding the Limitations of Deep Models for Molecular property prediction: Insights and SolutionsJun Xia, Lecheng Zhang, Xiao Zhu, Yue Liu et al.NeurIPS 2023 · 54 citations
- ET-Flow: Equivariant Flow-Matching for Molecular Conformer GenerationMajdi Hassan, Nikhil Shenoy, Jungyoon Lee, Hannes Stärk et al.NeurIPS 2024 · 50 citations
- Equivariant Graph Neural Operator for Modeling 3D DynamicsMinkai Xu, Jiaqi Han, Aaron Lou, Jean Kossaifi et al.ICML 2024 · 49 citations
Builds on23
- Improved Techniques for Training Score-Based Generative ModelsYang Song, Stefano ErmonNeurIPS 2020 · 1,527 citations
- E(n) Equivariant Graph Neural NetworksVictor Garcia Satorras, Emiel Hoogeboom, Max WellingICML 2021 · 1,432 citations
- Score-Based Generative Modeling through Stochastic Differential EquationsYang Song, Jascha Sohl-Dickstein, Diederik P. Kingma, Abhishek Kumar et al.ICLR 2021 · 1,270 citations
- Directional Message Passing for Molecular GraphsJohannes Klicpera, Janek Groß, Stephan GünnemannICLR 2020 · 1,079 citations
- Vector Neurons: A General Framework for SO(3)-Equivariant NetworksCongyue Deng, Or Litany, Yueqi Duan, Adrien Poulenard et al.ICCV 2021 · 411 citations
Related papers
- GotenNet: Rethinking Efficient 3D Equivariant Graph Neural NetworksSarp Aykent, Tian XiaICLR 2025
- Frame Averaging for Invariant and Equivariant Network DesignOmri Puny, Matan Atzmon, Edward J. Smith, Ishan Misra et al.ICLR 2022 · 177 citations
- Geometric and Physical Quantities improve E(3) Equivariant Message PassingJohannes Brandstetter, Rob Hesselink, Elise van der Pol, Erik J. Bekkers et al.ICLR 2022 · 307 citations
- Universally Invariant Learning in Equivariant GNNsJiacheng Cen, Anyi Li, Ning Lin, Tingyang Xu et al.NeurIPS 2025 · 7 citations
- Pose-Transformed Equivariant Network for 3D Point Trajectory PredictionRuixuan Yu, Jian SunCVPR 2024 · 2 citations
