Chemical-Reaction-Aware Molecule Representation Learning
Hongwei Wang, Weijiang Li, Xiaomeng Jin, Kyunghyun Cho, Heng Ji, Jiawei Han, Martin D. Burke
Abstract
Molecule representation learning (MRL) methods aim to embed molecules into a real vector space. However, existing SMILES-based (Simplified Molecular-Input Line-Entry System) or GNN-based (Graph Neural Networks) MRL methods either take SMILES strings as input that have difficulty in encoding molecule structure information, or over-emphasize the importance of GNN architectures but neglect their generalization ability. Here we propose using chemical reactions to assist learning molecule representation. The key idea of our approach is to preserve the equivalence of molecules with respect to chemical reactions in the embedding space, i.e., forcing the sum of reactant embeddings and the sum of product embeddings to be equal for each chemical equation. This constraint is proven effective to 1) keep the embedding space well-organized and 2) improve the generalization ability of molecule embeddings. Moreover, our model can use any GNN as the molecule encoder and is thus agnostic to GNN architectures. Experimental results demonstrate that our method achieves state-of-the-art performance in a variety of downstream tasks, e.g., 17.4% absolute Hit@1 gain in chemical reaction prediction, 2.3% absolute AUC gain in molecule property prediction, and 18.5% relative RMSE gain in graph-edit-distance prediction, respectively, over the best baseline method. The code is available at https://github.com/hwwang55/MolR .
Ask about this paper
Your agent reads all of it.
Lune indexed this paper to the last equation, along with the top-tier papers that cite it. Ask a question and the answer quotes them.
Your agent calls
Luneget_paper_fulltext
Free to start. No credit card required.
Terminal
Install the CLIlune papers fulltext 4d4c539a-f3ad-4e1f-b933-71a673f6cff0Cited by top-tier papers14
- Learning Substructure Invariance for Out-of-Distribution Molecular RepresentationsNianzu Yang, Kaipeng Zeng, Qitian Wu, Xiaosong Jia et al.NeurIPS 2022 · 133 citations
- Translation between Molecules and Natural LanguageCarl Edwards, Tuan Manh Lai, Kevin Ros, Garrett Honke et al.EMNLP 2022 · 112 citations
- Shift-Robust Molecular Relational Learning with Causal SubstructureNamkyeong Lee, Kanghoon Yoon, Gyoung S. Na, Sein Kim et al.KDD 2023 · 15 citations
- Uncertainty-Aware Yield Prediction with Multimodal Molecular FeaturesJiayuan Chen, Kehan Guo, Zhen Liu, Olexandr Isayev et al.AAAI 2024 · 13 citations
- Learning Chemical Rules of Retrosynthesis with Pre-trainingYinjie Jiang, Ying Wei, Fei Wu, Zhengxing Huang et al.AAAI 2023 · 12 citations
Builds on1
Related papers
- Unified 2D and 3D Pre-Training of Molecular RepresentationsJinhua Zhu, Yingce Xia, Lijun Wu, Shufang Xie et al.KDD 2022 · 53 citations
- Dual-view Molecular Pre-trainingJinhua Zhu, Yingce Xia, Lijun Wu, Shufang Xie et al.KDD 2023 · 47 citations
- Self-Supervised Graph Transformer on Large-Scale Molecular DataYu Rong, Yatao Bian, Tingyang Xu, Weiyang Xie et al.NeurIPS 2020 · 1,113 citations
- Generalizing Neural Wave FunctionsNicholas Gao, Stephan GünnemannICML 2023 · 38 citations
- Multilingual Molecular Representation Learning via Contrastive Pre-trainingZhihui Guo, Pramod Kumar Sharma, Andy Martinez, Liang Du et al.ACL 2022
