Equivariant Denoisers Cannot Copy Graphs: Align Your Graph Diffusion Models
Najwa Laabid, Severi Rissanen, Markus Heinonen, Arno Solin, Vikas Garg
Abstract
Graph diffusion models, dominant in graph generative modeling, remain underexplored for graph-to-graph translation tasks like chemical reaction prediction. We demonstrate that standard permutation equivariant denoisers face fundamental limitations in these tasks due to their inability to break symmetries in noisy inputs. To address this, we propose aligning input and target graphs to break input symmetries while preserving permutation equivariance in non-matching graph portions. Using retrosynthesis (i.e., the task of predicting precursors for synthesis of a given target molecule) as our application domain, we show how alignment dramatically improves discrete diffusion model performance from 5% to a SOTA-matching 54.7% top-1 accuracy. Code is available at https://github.com/Aalto-QuML/DiffAlign .
Ask about this paper
Your agent reads all of it.
Lune indexed this paper to the last equation, along with the top-tier papers that cite it. Ask a question and the answer quotes them.
Your agent calls
Luneget_paper_fulltext
Free to start. No credit card required.
Terminal
Install the CLIlune papers fulltext 6ed8c8ad-a988-4e99-a698-9cdd7f2e8776Cited by top-tier papers1
Ask how each one uses itBuilds on34
- Denoising Diffusion Probabilistic ModelsJonathan Ho, Ajay Jain, Pieter AbbeelNeurIPS 2020 · 35,902 citations
- Diffusion Models Beat GANs on Image SynthesisPrafulla Dhariwal, Alexander Quinn NicholNeurIPS 2021 · 13,211 citations
- Elucidating the Design Space of Diffusion-Based Generative ModelsTero Karras, Miika Aittala, Timo Aila, Samuli LaineNeurIPS 2022 · 3,959 citations
- Video Diffusion ModelsJonathan Ho, Tim Salimans, Alexey A. Gritsenko, William Chan et al.NeurIPS 2022 · 2,948 citations
- DPM-Solver: A Fast ODE Solver for Diffusion Probabilistic Model Sampling in Around 10 StepsCheng Lu, Yuhao Zhou, Fan Bao, Jianfei Chen et al.NeurIPS 2022 · 2,653 citations
Related papers
- Advancing Retrosynthesis with Retrieval-Augmented Graph GenerationAnjie Qiao, Zhen Wang, Jiahua Rao, Yuedong Yang et al.AAAI 2025 · 1 citation
- GDiffRetro: Retrosynthesis Prediction with Dual Graph Enhanced Molecular Representation and Diffusion GenerationShengyin Sun, Wenhao Yu, Yuxiang Ren, Weitao Du et al.AAAI 2025 · 8 citations
- A Graph to Graphs Framework for Retrosynthesis PredictionChence Shi, Minkai Xu, Hongyu Guo, Ming Zhang et al.ICML 2020 · 176 citations
- Scalable Non-Equivariant 3D Molecule Generation via Rotational AlignmentYuhui Ding, Thomas HofmannICML 2025
- Learning Graph Models for Retrosynthesis PredictionVignesh Ram Somnath, Charlotte Bunne, Connor W. Coley, Andreas Krause et al.NeurIPS 2021 · 137 citations
