3D Interaction Geometric Pre-training for Molecular Relational Learning
Namkyeong Lee, Yunhak Oh, Heewoong Noh, Gyoung S. Na, Minkai Xu, Hanchen Wang, Tianfan Fu, Chanyoung Park
Abstract
Molecular Relational Learning (MRL) is a rapidly growing field that focuses on understanding the interaction dynamics between molecules, which is crucial for applications ranging from catalyst engineering to drug discovery. Despite recent progress, earlier MRL approaches are limited to using only the 2D topological structure of molecules, as obtaining the 3D interaction geometry remains prohibitively expensive. This paper introduces a novel 3D geometric pre-training strategy for MRL (3DMRL) that incorporates a 3D virtual interaction environment, overcoming the limitations of costly traditional quantum mechanical calculation methods. With the constructed 3D virtual interaction environment, 3DMRL trains 2D MRL model to learn the global and local 3D geometric information of molecular interaction. Extensive experiments on various tasks using real-world datasets, including out-of-distribution and extrapolation scenarios, demonstrate the effectiveness of 3DMRL, showing up to a 24.93% improvement in performance across 40 tasks. Our code is publicly available at https://github.com/Namkyeong/3DMRL.
Ask about this paper
Your agent reads all of it.
Lune indexed this paper to the last equation, along with the top-tier papers that cite it. Ask a question and the answer quotes them.
Your agent calls
Luneget_paper_fulltext
Free to start. No credit card required.
Terminal
Install the CLIlune papers fulltext 7e979e38-63f7-437b-bdc4-30127e254f64Builds on13
- A Simple Framework for Contrastive Learning of Visual RepresentationsTing Chen, Simon Kornblith, Mohammad Norouzi, Geoffrey E. HintonICML 2020 · 24,064 citations
- Pre-training Molecular Graph Representation with 3D GeometryShengchao Liu, Hanchen Wang, Weiyang Liu, Joan Lasenby et al.ICLR 2022 · 440 citations
- 3D Infomax improves GNNs for Molecular Property PredictionHannes Stärk, Dominique Beaini, Gabriele Corso, Prudencio Tossou et al.ICML 2022 · 269 citations
- Multi-view Graph Contrastive Representation Learning for Drug-Drug Interaction PredictionYingheng Wang, Yaosen Min, Xin Chen, Ji WuWWW 2021 · 186 citations
- Energy-Motivated Equivariant Pretraining for 3D Molecular GraphsRui Jiao, Jiaqi Han, Wenbing Huang, Yu Rong et al.AAAI 2023 · 64 citations
Related papers
- Molecular Geometry Pretraining with SE(3)-Invariant Denoising Distance MatchingShengchao Liu, Hongyu Guo, Jian TangICLR 2023 · 17 citations
- Automated 3D Pre-Training for Molecular Property PredictionXu Wang, Huan Zhao, Wei-Wei Tu, Quanming YaoKDD 2023 · 28 citations
- Molecule Joint Auto-Encoding: Trajectory Pretraining with 2D and 3D DiffusionWeitao Du, Jiujiu Chen, Xuecang Zhang, Zhi-Ming Ma et al.NeurIPS 2023 · 15 citations
- A Group Symmetric Stochastic Differential Equation Model for Molecule Multi-modal PretrainingShengchao Liu, Weitao Du, Zhi-Ming Ma, Hongyu Guo et al.ICML 2023 · 46 citations
- Unified 2D and 3D Pre-Training of Molecular RepresentationsJinhua Zhu, Yingce Xia, Lijun Wu, Shufang Xie et al.KDD 2022 · 53 citations
