Deep Generative Model for Periodic Graphs
Shiyu Wang, Xiaojie Guo, Liang Zhao
Abstract
Periodic graphs are graphs consisting of repetitive local structures, such as crystal nets and polygon mesh. Their generative modeling has great potential in real-world applications such as material design and graphics synthesis. Classical models either rely on domain-specific predefined generation principles (e.g., in crystal net design), or follow geometry-based prescribed rules. Recently, deep generative models has shown great promise in automatically generating general graphs. However, their advancement into periodic graphs have not been well explored due to several key challenges in 1) maintaining graph periodicity; 2) disentangling local and global patterns; and 3) efficiency in learning repetitive patterns. To address them, this paper proposes Periodical-Graph Disentangled Variational Auto-encoder (PGD-VAE), a new deep generative models for periodic graphs that can automatically learn, disentangle, and generate local and global graph patterns. Specifically, we develop a new periodic graph encoder consisting of global-pattern encoder and local-pattern encoder that ensures to disentangle the representation into global and local semantics. We then propose a new periodic graph decoder consisting of local structure decoder, neighborhood decoder, and global structure decoder, as well as the assembler of their outputs that guarantees periodicity. Moreover, we design a new model learning objective that helps ensure the invariance of local-semantic representations for the graphs with the same local structure. Comprehensive experimental evaluations have been conducted to demonstrate the effectiveness of the proposed method. The code of proposed PGD-VAE is availabe at https://github.com/shi-yu-wang/PGD-VAE.
Ask about this paper
Your agent reads all of it.
Lune indexed this paper to the last equation, along with the top-tier papers that cite it. Ask a question and the answer quotes them.
Cited by top-tier papers6
- Periodic Graph Transformers for Crystal Material Property PredictionKeqiang Yan, Yi Liu, Yuchao Lin, Shuiwang JiNeurIPS 2022 · 167 citations
- Towards Symmetry-Aware Generation of Periodic MaterialsYouzhi Luo, Chengkai Liu, Shuiwang JiNeurIPS 2023 · 50 citations
- Curriculum Learning for Graph Neural Networks: Which Edges Should We Learn FirstZheng Zhang, Junxiang Wang, Liang ZhaoNeurIPS 2023 · 30 citations
- Multi-objective Deep Data Generation with Correlated Property ControlShiyu Wang, Xiaojie Guo, Xuanyang Lin, Bo Pan et al.NeurIPS 2022 · 19 citations
- Representation Learning of Geometric TreesZheng Zhang, Allen Zhang, Ruth Nelson, Giorgio A. Ascoli et al.KDD 2024
Builds on8
- Graph Contrastive Learning with AugmentationsYuning You, Tianlong Chen, Yongduo Sui, Ting Chen et al.NeurIPS 2020 · 3,042 citations
- Crystal Diffusion Variational Autoencoder for Periodic Material GenerationTian Xie, Xiang Fu, Octavian-Eugen Ganea, Regina Barzilay et al.ICLR 2022 · 394 citations
- SPECTRE: Spectral Conditioning Helps to Overcome the Expressivity Limits of One-shot Graph GeneratorsKarolis Martinkus, Andreas Loukas, Nathanaël Perraudin, Roger WattenhoferICML 2022 · 109 citations
- Interpretable Deep Graph Generation with Node-edge Co-disentanglementXiaojie Guo, Liang Zhao, Zhao Qin, Lingfei Wu et al.KDD 2020 · 28 citations
- TG-GAN: Continuous-time Temporal Graph Deep Generative Models with Time-Validity ConstraintsLiming Zhang, Liang Zhao, Shan Qin, Dieter Pfoser et al.WWW 2021 · 25 citations
Related papers
- Physical-regularized Hierarchical Generative Model for Metallic Glass Structural Generation and Energy PredictionQiyuan Chen, Ajay Annamareddy, Ying-Fei Li, Dane Morgan et al.AAAI 2026 · 3 citations
- Molecule Generation by Principal Subgraph Mining and AssemblingXiangzhe Kong, Wenbing Huang, Zhixing Tan, Yang LiuNeurIPS 2022 · 90 citations
- Geometric Graph Representation Learning on Protein Structure PredictionTian Xia, Wei-Shinn KuKDD 2021 · 28 citations
- Symmetry-induced Disentanglement on GraphsGiangiacomo Mercatali, André Freitas, Vikas GargNeurIPS 2022 · 10 citations
- VarScene: A Deep Generative Model for Realistic Scene Graph SynthesisTathagat Verma, Abir De, Yateesh Agrawal, Vishwa Vinay et al.ICML 2022 · 11 citations
