Distributional Priors Guided Diffusion for Generating 3D Molecules in Low Data Regimes
Haokai Hong, Wanyu Lin, Ming Yang, Kay Chen Tan
Abstract
Can we train a 3D molecule generator using data from dense regions to generate samples in sparse regions? This challenge can be framed as an out-of-distribution (OOD) generation problem. While prior research on OOD generation predominantly targets property shifts, structural shifts, such as differences in molecular scaffolds or functional groups, represent an equally critical source of distributional shifts. This work introduces the Geometric OOD Diffusion Model (GODD), a novel diffusion-based framework that enables training on data-abundant molecular distributions while generalizing to data-scarce distributions under distributional structural shifts. Central to our approach is a designated equivariant asymmetric autoencoder to capture distributional structural priors. The asymmetric design allows the model to generalize to unseen structural variations by capturing distributional priors representing distinct distributions. The encoded structural-grained priors guide generation toward sparse regions without requiring explicit training on such data. Evaluated across standard benchmarks encompassing OOD structural shifts (e.g., scaffolds, rings), GODD achieves an improvement of 12.6% in success rate, defined based on molecular validity, uniqueness, and novelty. Furthermore, the framework demonstrates promising performance and generalization on canonical fragment-based drug design tasks, highlighting its utility in learning-based molecular discovery.
Ask about this paper
Your agent reads all of it.
Lune indexed this paper to the last equation, along with the top-tier papers that cite it. Ask a question and the answer quotes them.
Your agent calls
Luneget_paper_fulltext
Free to start. No credit card required.
Terminal
Install the CLIlune papers fulltext e5f9f217-7f18-4165-8ecb-813ed19a43a9Cited by top-tier papers1
Ask how each one uses itBuilds on21
- Denoising Diffusion Probabilistic ModelsJonathan Ho, Ajay Jain, Pieter AbbeelNeurIPS 2020 · 35,902 citations
- E(n) Equivariant Graph Neural NetworksVictor Garcia Satorras, Emiel Hoogeboom, Max WellingICML 2021 · 1,432 citations
- GraphAF: a Flow-based Autoregressive Model for Molecular Graph GenerationChence Shi, Minkai Xu, Zhaocheng Zhu, Weinan Zhang et al.ICLR 2020 · 532 citations
- Crystal Diffusion Variational Autoencoder for Periodic Material GenerationTian Xie, Xiang Fu, Octavian-Eugen Ganea, Regina Barzilay et al.ICLR 2022 · 394 citations
- Geometric Latent Diffusion Models for 3D Molecule GenerationMinkai Xu, Alexander S. Powers, Ron O. Dror, Stefano Ermon et al.ICML 2023 · 252 citations
Related papers
- Navigating the Design Space of Equivariant Diffusion-Based Generative Models for De Novo 3D Molecule GenerationTuan Le, Julian Cremer, Frank Noé, Djork-Arné Clevert et al.ICLR 2024 · 54 citations
- Exploring Chemical Space with Score-based Out-of-distribution GenerationSeul Lee, Jaehyeong Jo, Sung Ju HwangICML 2023 · 110 citations
- Improving Out-of-Distribution Generalization in Graphs via Hierarchical Semantic EnvironmentsYinhua Piao, Sangseon Lee, Yijingxiu Lu, Sun KimCVPR 2024 · 6 citations
- Learning Substructure Invariance for Out-of-Distribution Molecular RepresentationsNianzu Yang, Kaipeng Zeng, Qitian Wu, Xiaosong Jia et al.NeurIPS 2022 · 133 citations
- Invariant Conditional Molecular Generation Under Distribution ShiftChunyu Hu, Tianyin Liao, Yicheng Sui, Ran Zhang et al.AAAI 2026
