From Uniform to Learned Graph Priors: Diffusion for Structure Discovery
Qi Shao, Hao Guo, Jiawen Chen, Duxin Chen, Wenwu Yu
Abstract
Neural relational inference (NRI) methods discover interaction graphs from trajectories through variational reasoning on discrete potential edges. However, these methods typically rely on oversimplified, factorized graph priors. Such priors, typically nearing uniform distributions, treat edges as independent entities. This systemic misalignment does not match the real-world systems and yields diffuse and indecisive edge posteriors limiting the reliability of structural discovery. To address this, we propose Diff-prior, a diffusion-parameterized adaptive prior used to calibrate latent graph distribution rather than generate graphs. Our core insight is to reframe prior integration as a learnable denoising-style calibration that organizes scattered, uncertain edge posteriors into a more reliable overall structure which can be trained by the diffusion model. Diff-prior learns an adaptive structure prior that performs structured calibration on the edge posteriors during inference, guiding it towards a distribution closer to the underlying structure. The diff-prior operates before structural sampling and acts as a denoising calibrator directly on the encoder edge distribution, which provides a generic training paradigm over structured variables. Experiments on standard benchmarks validated our framework, and the results indicate that Diff-prior improves the performance of structure inference and generates more decisive edge posteriors across multiple NRI-family architectures. The code is available on https://github.com/Hardy158118/Diffprior.
Ask about this paper
Your agent reads all of it.
Lune indexed this paper to the last equation, along with the top-tier papers that cite it. Ask a question and the answer quotes them.
Your agent calls
Luneget_paper_fulltext
Free to start. No credit card required.
Terminal
Install the CLIlune papers fulltext 3dc4061f-eeae-44b9-a2a2-af130b1c9c16Builds on13
- Denoising Diffusion Probabilistic ModelsJonathan Ho, Ajay Jain, Pieter AbbeelNeurIPS 2020 · 35,902 citations
- Learning to Simulate Complex Physics with Graph NetworksAlvaro Sanchez-Gonzalez, Jonathan Godwin, Tobias Pfaff, Rex Ying et al.ICML 2020 · 1,439 citations
- Autoregressive Diffusion Model for Graph GenerationLingkai Kong, Jiaming Cui, Haotian Sun, Yuchen Zhuang et al.ICML 2023 · 105 citations
- Graph Diffusion Transformers for Multi-Conditional Molecular GenerationGang Liu, Jiaxin Xu, Tengfei Luo, Meng JiangNeurIPS 2024 · 73 citations
- DiGress: Discrete Denoising diffusion for graph generationClément Vignac, Igor Krawczuk, Antoine Siraudin, Bohan Wang et al.ICLR 2023 · 70 citations
Related papers
- A Graph Dynamics Prior for Relational InferenceLiming Pan, Cheng Shi, Ivan DokmanicAAAI 2024 · 6 citations
- IPSI: Enhancing Structural Inference with Automatically Learned Structural PriorsZhongben Gong, Xiaoqun Wu, Mingyang ZhouNeurIPS 2025 · 1 citation
- Neural Relational Inference with Efficient Message Passing MechanismsSiyuan Chen, Jiahai Wang, Guoqing LiAAAI 2021 · 25 citations
- Guided Structural Inference: Leveraging Priors with Soft Gating MechanismsAoran Wang, Xinnan Dai, Jun PangICML 2025
- Uncertainty-Calibrated Diffusion for Reliable 3D Molecular Graph GenerationFang Wan, Jingxiang Qu, Yi LiuKDD 2026
