Learning Flexible Forward Trajectories for Masked Molecular Diffusion
Hyunjin Seo, Taewon Kim, Sihyun Yu, Sungsoo Ahn
Abstract
Masked diffusion models (MDMs) have achieved notable progress in modeling discrete data, while their potential in molecular generation remains underexplored. In this work, we explore their potential and introduce the surprising result that naively applying standards MDMs severely degrades the performance. We identify the critical cause of this issue as a state-clashing problem-where the forward diffusion of distinct molecules collapse into a common state, resulting in a mixture of reconstruction targets that cannot be learned using typical reverse diffusion process with unimodal predictions. To mitigate this, we propose Masked Element-wise Learnable Diffusion (MELD) that orchestrates per-element corruption trajectories to avoid collision between distinct molecular graphs. This is achieved through a parameterized noise scheduling network that assigns distinct corruption rates to individual graph elements, i.e., atoms and bonds. Extensive experiments on diverse molecular benchmarks reveal that MELD markedly enhances overall generation quality compared to element-agnostic noise scheduling, increasing the chemical validity of vanilla MDMs on ZINC250K from 15% to 93%, Furthermore, it achieves state-of-the-art property alignment in conditional generation tasks.
Ask about this paper
Your agent reads all of it.
Lune indexed this paper to the last equation, along with the top-tier papers that cite it. Ask a question and the answer quotes them.
Your agent calls
Luneget_paper_fulltext
Free to start. No credit card required.
Terminal
Install the CLIlune papers fulltext eb991334-917f-4a26-a326-7b3f002750ffCited by top-tier papers1
Ask how each one uses itBuilds on40
- Denoising Diffusion Probabilistic ModelsJonathan Ho, Ajay Jain, Pieter AbbeelNeurIPS 2020 · 35,902 citations
- Diffusion Models Beat GANs on Image SynthesisPrafulla Dhariwal, Alexander Quinn NicholNeurIPS 2021 · 13,211 citations
- High-Resolution Image Synthesis with Latent Diffusion ModelsRobin Rombach, Andreas Blattmann, Dominik Lorenz, Patrick Esser et al.CVPR 2022 · 13,123 citations
- Scalable Diffusion Models with TransformersWilliam Peebles, Saining XieICCV 2023 · 5,568 citations
- Improved Denoising Diffusion Probabilistic ModelsAlexander Quinn Nichol, Prafulla DhariwalICML 2021 · 5,234 citations
Related papers
- Insertion Based Sequence Generation with Learnable Order DynamicsDhruvesh Patel, Benjamin Rozonoyer, Gaurav Pandey, Tahira Naseem et al.ICML 2026 · 1 citation
- BiMol-Diff: A Unified Diffusion Framework for Molecular Generation and CaptioningAditya Hemant Shahane, Anuj Kumar Sirohi, Devansh Arora, Nitin Kumar et al.ACL 2026
- MolDiff: Addressing the Atom-Bond Inconsistency Problem in 3D Molecule Diffusion GenerationXingang Peng, Jiaqi Guan, Qiang Liu, Jianzhu MaICML 2023 · 76 citations
- Learnable Sampler Distillation for Discrete Diffusion ModelsFeiyang Fu, Tongxian Guo, Zhaoqiang LiuNeurIPS 2025 · 10 citations
- Equivariant Denoisers Cannot Copy Graphs: Align Your Graph Diffusion ModelsNajwa Laabid, Severi Rissanen, Markus Heinonen, Arno Solin et al.ICLR 2025
