Context-Guided Diffusion for Out-of-Distribution Molecular and Protein Design
Leo Klarner, Tim G. J. Rudner, Garrett M. Morris, Charlotte M. Deane, Yee Whye Teh
Abstract
Generative models have the potential to accelerate key steps in the discovery of novel molecular therapeutics and materials. Diffusion models have recently emerged as a powerful approach, excelling at unconditional sample generation and, with data-driven guidance, conditional generation within their training domain. Reliably sampling from high-value regions beyond the training data, however, remains an open challenge -- with current methods predominantly focusing on modifying the diffusion process itself. In this paper, we develop context-guided diffusion (CGD), a simple plug-and-play method that leverages unlabeled data and smoothness constraints to improve the out-of-distribution generalization of guided diffusion models. We demonstrate that this approach leads to substantial performance gains across various settings, including continuous, discrete, and graph-structured diffusion processes with applications across drug discovery, materials science, and protein design.
Ask about this paper
Your agent reads all of it.
Lune indexed this paper to the last equation, along with the top-tier papers that cite it. Ask a question and the answer quotes them.
Your agent calls
Luneget_paper_fulltext
Free to start. No credit card required.
Terminal
Install the CLIlune papers fulltext 668871be-ea16-47f3-b342-06baef7da973Cited by top-tier papers9
- Steering Generative Models with Experimental Data for Protein Fitness OptimizationJason Yang, Wenda Chu, Daniel Khalil, Raul Astudillo et al.NeurIPS 2025 · 13 citations
- Diffusion Twigs with Loop Guidance for Conditional Graph GenerationGiangiacomo Mercatali, Yogesh Verma, André Freitas, Vikas GargNeurIPS 2024 · 8 citations
- Verifier-Constrained Flow Expansion for Discovery Beyond the DataRiccardo De Santi, Kimon Protopapas, Ya-Ping Hsieh, Andreas KrauseICLR 2026 · 6 citations
- Distributional Priors Guided Diffusion for Generating 3D Molecules in Low Data RegimesHaokai Hong, Wanyu Lin, Ming Yang, Kay Chen TanAAAI 2026 · 1 citation
- Unlocking Guidance for Discrete State-Space Diffusion and Flow ModelsHunter Nisonoff, Junhao Xiong, Stephan Allenspach, Jennifer ListgartenICLR 2025
Builds on30
- Language Models are Few-Shot LearnersTom B. Brown, Benjamin Mann, Nick Ryder, Melanie Subbiah et al.NeurIPS 2020 · 64,255 citations
- Denoising Diffusion Probabilistic ModelsJonathan Ho, Ajay Jain, Pieter AbbeelNeurIPS 2020 · 35,902 citations
- Diffusion Models Beat GANs on Image SynthesisPrafulla Dhariwal, Alexander Quinn NicholNeurIPS 2021 · 13,211 citations
- High-Resolution Image Synthesis with Latent Diffusion ModelsRobin Rombach, Andreas Blattmann, Dominik Lorenz, Patrick Esser et al.CVPR 2022 · 13,123 citations
- Photorealistic Text-to-Image Diffusion Models with Deep Language UnderstandingChitwan Saharia, William Chan, Saurabh Saxena, Lala Li et al.NeurIPS 2022 · 8,965 citations
Related papers
- Conditional Diffusion Based on Discrete Graph Structures for Molecular Graph GenerationHan Huang, Leilei Sun, Bowen Du, Weifeng LvAAAI 2023 · 72 citations
- Unified Guidance for Geometry-Conditioned Molecular GenerationSirine Ayadi, Leon Hetzel, Johanna Sommer, Fabian J. Theis et al.NeurIPS 2024 · 11 citations
- Exploring Chemical Space with Score-based Out-of-distribution GenerationSeul Lee, Jaehyeong Jo, Sung Ju HwangICML 2023 · 110 citations
- Discrete-state Continuous-time Diffusion for Graph GenerationZhe Xu, Ruizhong Qiu, Yuzhong Chen, Huiyuan Chen et al.NeurIPS 2024 · 92 citations
- Training-free Multi-objective Diffusion Model for 3D Molecule GenerationXu Han, Caihua Shan, Yifei Shen, Can Xu et al.ICLR 2024 · 20 citations
