Symmetry-induced Disentanglement on Graphs
Giangiacomo Mercatali, André Freitas, Vikas Garg
Abstract
Learning disentangled representations is important for unraveling the underlying complex interactions between latent generative factors. Disentanglement has been formalized using a symmetry-centric notion for unstructured spaces, however, graphs have eluded a similarly rigorous treatment. We fill this gap with a new notion of conditional symmetry for disentanglement, and leverage tools from Lie algebras to encode graph properties into subgroups using suitable adaptations of generative models such as Variational Autoencoders. Unlike existing works on disentanglement, the proposed models segregate the latent space into uncoupled and entangled parts. Experiments on synthetic and real datasets suggest that these models can learn effective disengaged representations, and improve performance on downstream tasks such as few-shot classification and molecular generation.
Ask about this paper
Your agent reads all of it.
Lune indexed this paper to the last equation, along with the top-tier papers that cite it. Ask a question and the answer quotes them.
Your agent calls
Luneget_paper_fulltext
Free to start. No credit card required.
Terminal
Install the CLIlune papers fulltext 9122764a-cdcc-40e0-b11e-7675ff7092feCited by top-tier papers3
- Disentangled Multiplex Graph Representation LearningYujie Mo, Yajie Lei, Jialie Shen, Xiaoshuang Shi et al.ICML 2023 · 35 citations
- Retrieval-based Disentangled Representation Learning with Natural Language SupervisionJiawei Zhou, Xiaoguang Li, Lifeng Shang, Xin Jiang et al.ICLR 2024
- Disentangling Hyperedges through the Lens of Category TheoryYoonho Lee, Junseok Lee, Sangwoo Seo, Sungwon Kim et al.NeurIPS 2025
Builds on26
- GraphAF: a Flow-based Autoregressive Model for Molecular Graph GenerationChence Shi, Minkai Xu, Zhaocheng Zhu, Weinan Zhang et al.ICLR 2020 · 532 citations
- Graph Information BottleneckTailin Wu, Hongyu Ren, Pan Li, Jure LeskovecNeurIPS 2020 · 366 citations
- Generalization and Representational Limits of Graph Neural NetworksVikas K. Garg, Stefanie Jegelka, Tommi S. JaakkolaICML 2020 · 363 citations
- GraphDF: A Discrete Flow Model for Molecular Graph GenerationYouzhi Luo, Keqiang Yan, Shuiwang JiICML 2021 · 264 citations
- Equivariant Subgraph Aggregation NetworksBeatrice Bevilacqua, Fabrizio Frasca, Derek Lim, Balasubramaniam Srinivasan et al.ICLR 2022 · 217 citations
Related papers
- Commutative Lie Group VAE for Disentanglement LearningXinqi Zhu, Chang Xu, Dacheng TaoICML 2021 · 35 citations
- Towards Building A Group-based Unsupervised Representation Disentanglement FrameworkTao Yang, Xuanchi Ren, Yuwang Wang, Wenjun Zeng et al.ICLR 2022 · 36 citations
- Interpretable Deep Graph Generation with Node-edge Co-disentanglementXiaojie Guo, Liang Zhao, Zhao Qin, Lingfei Wu et al.KDD 2020 · 28 citations
- 3DLinker: An E(3) Equivariant Variational Autoencoder for Molecular Linker DesignYinan Huang, Xingang Peng, Jianzhu Ma, Muhan ZhangICML 2022 · 65 citations
- Structuring Representations Using Group InvariantsMehran Shakerinava, Arnab Kumar Mondal, Siamak RavanbakhshNeurIPS 2022 · 23 citations
