MACE: Higher Order Equivariant Message Passing Neural Networks for Fast and Accurate Force Fields
Ilyes Batatia, Dávid Péter Kovács, Gregor N. C. Simm, Christoph Ortner, Gábor Csányi
Abstract
Creating fast and accurate force fields is a long-standing challenge in computational chemistry and materials science. Recently, several equivariant message passing neural networks (MPNNs) have been shown to outperform models built using other approaches in terms of accuracy. However, most MPNNs suffer from high computational cost and poor scalability. We propose that these limitations arise because MPNNs only pass two-body messages leading to a direct relationship between the number of layers and the expressivity of the network. In this work, we introduce MACE, a new equivariant MPNN model that uses higher body order messages. In particular, we show that using four-body messages reduces the required number of message passing iterations to just two, resulting in a fast and highly parallelizable model, reaching or exceeding state-of-the-art accuracy on the rMD17, 3BPA, and AcAc benchmark tasks. We also demonstrate that using higher order messages leads to an improved steepness of the learning curves.
Ask about this paper
Your agent reads all of it.
Lune indexed this paper to the last equation, along with the top-tier papers that cite it. Ask a question and the answer quotes them.
Your agent calls
Luneget_paper_fulltext
Free to start. No credit card required.
Terminal
Install the CLIlune papers fulltext 8585c5cd-b97e-4662-97a0-c26b1f22262cCited by top-tier papers46
- EquiformerV2: Improved Equivariant Transformer for Scaling to Higher-Degree RepresentationsYi-Lun Liao, Brandon M. Wood, Abhishek Das, Tess E. SmidtICLR 2024 · 311 citations
- TensorNet: Cartesian Tensor Representations for Efficient Learning of Molecular PotentialsGuillem Simeon, Gianni De FabritiisNeurIPS 2023 · 100 citations
- Geometric Algebra TransformerJohann Brehmer, Pim de Haan, Sönke Behrends, Taco S. CohenNeurIPS 2023 · 81 citations
- A new perspective on building efficient and expressive 3D equivariant graph neural networksWeitao Du, Yuanqi Du, Limei Wang, Dieqiao Feng et al.NeurIPS 2023 · 80 citations
- 3D molecule generation by denoising voxel gridsPedro O. Pinheiro, Joshua A. Rackers, Joseph Kleinhenz, Michael Maser et al.NeurIPS 2023 · 55 citations
Builds on6
- E(n) Equivariant Graph Neural NetworksVictor Garcia Satorras, Emiel Hoogeboom, Max WellingICML 2021 · 1,432 citations
- Directional Message Passing for Molecular GraphsJohannes Klicpera, Janek Groß, Stephan GünnemannICLR 2020 · 1,079 citations
- Equivariant message passing for the prediction of tensorial properties and molecular spectraKristof Schütt, Oliver T. Unke, Michael GasteggerICML 2021 · 736 citations
- GemNet: Universal Directional Graph Neural Networks for MoleculesJohannes Gasteiger, Florian Becker, Stephan GünnemannNeurIPS 2021 · 665 citations
- Geometric and Physical Quantities improve E(3) Equivariant Message PassingJohannes Brandstetter, Rob Hesselink, Elise van der Pol, Erik J. Bekkers et al.ICLR 2022 · 307 citations
Related papers
- Higher-Rank Irreducible Cartesian Tensors for Equivariant Message PassingViktor Zaverkin, Francesco Alesiani, Takashi Maruyama, Federico Errica et al.NeurIPS 2024 · 19 citations
- Learning Equivariant Non-Local Electron Density FunctionalsNicholas Gao, Eike Eberhard, Stephan GünnemannICLR 2025
- Quadruple Attention in Many-body Systems for Accurate Molecular Property PredictionsJiahua Rao, Dahao Xu, Wentao Wei, Yicong Chen et al.ICML 2025
- A Recipe for Charge Density PredictionXiang Fu, Andrew S. Rosen, Kyle Bystrom, Rui Wang et al.NeurIPS 2024 · 26 citations
- Efficiently incorporating quintuple interactions into geometric deep learning force fieldsZun Wang, Guoqing Liu, Yichi Zhou, Tong Wang et al.NeurIPS 2023 · 15 citations
