Pre-training Molecular Graph Representation with 3D Geometry
Shengchao Liu, Hanchen Wang, Weiyang Liu, Joan Lasenby, Hongyu Guo, Jian Tang
Abstract
Molecular graph representation learning is a fundamental problem in modern drug and material discovery. Molecular graphs are typically modeled by their 2D topological structures, but it has been recently discovered that 3D geometric information plays a more vital role in predicting molecular functionalities. However, the lack of 3D information in real-world scenarios has significantly impeded the learning of geometric graph representation. To cope with this challenge, we propose the Graph Multi-View Pre-training (GraphMVP) framework where self-supervised learning (SSL) is performed by leveraging the correspondence and consistency between 2D topological structures and 3D geometric views. GraphMVP effectively learns a 2D molecular graph encoder that is enhanced by richer and more discriminative 3D geometry. We further provide theoretical insights to justify the effectiveness of GraphMVP. Finally, comprehensive experiments show that GraphMVP can consistently outperform existing graph SSL methods. Code is available on GitHub.
Ask about this paper
Your agent reads all of it.
Lune indexed this paper to the last equation, along with the top-tier papers that cite it. Ask a question and the answer quotes them.
Your agent calls
Luneget_paper_fulltext
Free to start. No credit card required.
Terminal
Install the CLIlune papers fulltext 0d855499-aba0-4804-8a6f-30e92f892537Cited by top-tier papers107
- Pocket2Mol: Efficient Molecular Sampling Based on 3D Protein PocketsXingang Peng, Shitong Luo, Jiaqi Guan, Qi Xie et al.ICML 2022 · 291 citations
- 3D Infomax improves GNNs for Molecular Property PredictionHannes Stärk, Dominique Beaini, Gabriele Corso, Prudencio Tossou et al.ICML 2022 · 269 citations
- Uni-Mol: A Universal 3D Molecular Representation Learning FrameworkGengmo Zhou, Zhifeng Gao, Qiankun Ding, Hang Zheng et al.ICLR 2023 · 254 citations
- Learning Causally Invariant Representations for Out-of-Distribution Generalization on GraphsYongqiang Chen, Yonggang Zhang, Yatao Bian, Han Yang et al.NeurIPS 2022 · 246 citations
- Diffusion-based Molecule Generation with Informative Prior BridgesLemeng Wu, Chengyue Gong, Xingchao Liu, Mao Ye et al.NeurIPS 2022 · 165 citations
Builds on29
- Language Models are Few-Shot LearnersTom B. Brown, Benjamin Mann, Nick Ryder, Melanie Subbiah et al.NeurIPS 2020 · 64,255 citations
- A Simple Framework for Contrastive Learning of Visual RepresentationsTing Chen, Simon Kornblith, Mohammad Norouzi, Geoffrey E. HintonICML 2020 · 24,064 citations
- Bootstrap Your Own Latent - A New Approach to Self-Supervised LearningJean-Bastien Grill, Florian Strub, Florent Altché, Corentin Tallec et al.NeurIPS 2020 · 9,171 citations
- Supervised Contrastive LearningPrannay Khosla, Piotr Teterwak, Chen Wang, Aaron Sarna et al.NeurIPS 2020 · 7,049 citations
- Unsupervised Learning of Visual Features by Contrasting Cluster AssignmentsMathilde Caron, Ishan Misra, Julien Mairal, Priya Goyal et al.NeurIPS 2020 · 5,249 citations
Related papers
- GeomGCL: Geometric Graph Contrastive Learning for Molecular Property PredictionShuangli Li, Jingbo Zhou, Tong Xu, Dejing Dou et al.AAAI 2022 · 158 citations
- Cross-view Contrastive Unification Guides Generative Pretraining for Molecular Property PredictionJunyu Lin, Yan Zheng, Xinyue Chen, Yazhou Ren et al.ACM MM 2024 · 8 citations
- Molecule Joint Auto-Encoding: Trajectory Pretraining with 2D and 3D DiffusionWeitao Du, Jiujiu Chen, Xuecang Zhang, Zhi-Ming Ma et al.NeurIPS 2023 · 15 citations
- KPGT: Knowledge-Guided Pre-training of Graph Transformer for Molecular Property PredictionHan Li, Dan Zhao, Jianyang ZengKDD 2022 · 55 citations
- 3D Interaction Geometric Pre-training for Molecular Relational LearningNamkyeong Lee, Yunhak Oh, Heewoong Noh, Gyoung S. Na et al.NeurIPS 2025
