Data-Efficient Graph Grammar Learning for Molecular Generation
Minghao Guo, Veronika Thost, Beichen Li, Payel Das, Jie Chen, Wojciech Matusik
Abstract
The problem of molecular generation has received significant attention recently. Existing methods are typically based on deep neural networks and require training on large datasets with tens of thousands of samples. In practice, however, the size of class-specific chemical datasets is usually limited (e.g., dozens of samples) due to labor-intensive experimentation and data collection. This presents a considerable challenge for the deep learning generative models to comprehensively describe the molecular design space. Another major challenge is to generate only physically synthesizable molecules. This is a non-trivial task for neural network-based generative models since the relevant chemical knowledge can only be extracted and generalized from the limited training data. In this work, we propose a data-efficient generative model that can be learned from datasets with orders of magnitude smaller sizes than common benchmarks. At the heart of this method is a learnable graph grammar that generates molecules from a sequence of production rules. Without any human assistance, these production rules are automatically constructed from training data. Furthermore, additional chemical knowledge can be incorporated in the model by further grammar optimization. Our learned graph grammar yields state-of-the-art results on generating high-quality molecules for three monomer datasets that contain only samples each. Our approach also achieves remarkable performance in a challenging polymer generation task with only training samples and is competitive against existing methods using k data points. Code is available at https://github.com/gmh14/data_efficient_grammar.
Ask about this paper
Your agent reads all of it.
Lune indexed this paper to the last equation, along with the top-tier papers that cite it. Ask a question and the answer quotes them.
Your agent calls
Luneget_paper_fulltext
Free to start. No credit card required.
Terminal
Install the CLIlune papers fulltext 83dc6f2e-23d5-4b6e-b6f9-081ff6bc7128Cited by top-tier papers14
- Grammar Prompting for Domain-Specific Language Generation with Large Language ModelsBailin Wang, Zi Wang, Xuezhi Wang, Yuan Cao et al.NeurIPS 2023 · 138 citations
- Activity Grammars for Temporal Action SegmentationDayoung Gong, Joonseok Lee, Deunsol Jung, Suha Kwak et al.NeurIPS 2023 · 17 citations
- A Simple and Scalable Representation for Graph GenerationYunhui Jang, Seul Lee, Sungsoo AhnICLR 2024 · 14 citations
- Beam Enumeration: Probabilistic Explainability For Sample Efficient Self-conditioned Molecular DesignJeff Guo, Philippe SchwallerICLR 2024 · 9 citations
- De Novo Molecular Generation via Connection-aware Motif MiningZijie Geng, Shufang Xie, Yingce Xia, Lijun Wu et al.ICLR 2023 · 8 citations
Builds on3
- Strategies for Pre-training Graph Neural NetworksWeihua Hu, Bowen Liu, Joseph Gomes, Marinka Zitnik et al.ICLR 2020 · 1,744 citations
- Hierarchical Generation of Molecular Graphs using Structural MotifsWengong Jin, Regina Barzilay, Tommi S. JaakkolaICML 2020 · 356 citations
- Retro*: Learning Retrosynthetic Planning with Neural Guided A* SearchBinghong Chen, Chengtao Li, Hanjun Dai, Le SongICML 2020 · 151 citations
Related papers
- Hierarchical Grammar-Induced Geometry for Data-Efficient Molecular Property PredictionMinghao Guo, Veronika Thost, Samuel W. Song, Adithya Balachandran et al.ICML 2023
- Representing Molecules as Random Walks Over Interpretable GrammarsMichael Sun, Minghao Guo, Weize Yuan, Veronika Thost et al.ICML 2024 · 6 citations
- Foundation Molecular Grammar: Multi-Modal Foundation Models Induce Interpretable Molecular Graph LanguagesMichael Sun, Weize Yuan, Gang Liu, Wojciech Matusik et al.ICML 2025
- GraphAF: a Flow-based Autoregressive Model for Molecular Graph GenerationChence Shi, Minkai Xu, Zhaocheng Zhu, Weinan Zhang et al.ICLR 2020 · 532 citations
- Barking up the right tree: an approach to search over molecule synthesis DAGsJohn Bradshaw, Brooks Paige, Matt J. Kusner, Marwin H. S. Segler et al.NeurIPS 2020 · 71 citations
