Autobahn: Automorphism-based Graph Neural Nets
Erik H. Thiede, Wenda Zhou, Risi Kondor
Abstract
We introduce Automorphism-based graph neural networks (Autobahn), a new family of graph neural networks. In an Autobahn, we decompose the graph into a collection of subgraphs and apply local convolutions that are equivariant to each subgraph's automorphism group. Specific choices of local neighborhoods and subgraphs recover existing architectures such as message passing neural networks. Our formalism also encompasses novel architectures: as an example, we introduce a graph neural network that decomposes the graph into paths and cycles. The resulting convolutions reflect the natural way that parts of the graph can transform, preserving the intuitive meaning of convolution without sacrificing global permutation equivariance. We validate our approach by applying Autobahn to molecular graphs, where it achieves results competitive with state-of-the-art message passing algorithms. 35th Conference on Neural Information Processing Systems (NeurIPS 2021).
Ask about this paper
Your agent reads all of it.
Lune indexed this paper to the last equation, along with the top-tier papers that cite it. Ask a question and the answer quotes them.
Your agent calls
Luneget_paper_fulltext
Free to start. No credit card required.
Terminal
Install the CLIlune papers fulltext 799df09f-c1c0-474f-b480-78b2b16aa7c0Cited by top-tier papers29
- Equivariant Subgraph Aggregation NetworksBeatrice Bevilacqua, Fabrizio Frasca, Derek Lim, Balasubramaniam Srinivasan et al.ICLR 2022 · 217 citations
- From Stars to Subgraphs: Uplifting Any GNN with Local Structure AwarenessLingxiao Zhao, Wei Jin, Leman Akoglu, Neil ShahICLR 2022 · 213 citations
- Understanding and Extending Subgraph GNNs by Rethinking Their SymmetriesFabrizio Frasca, Beatrice Bevilacqua, Michael M. Bronstein, Haggai MaronNeurIPS 2022 · 168 citations
- Ordered Subgraph Aggregation NetworksChendi Qian, Gaurav Rattan, Floris Geerts, Mathias Niepert et al.NeurIPS 2022 · 81 citations
- Learning Physical Dynamics with Subequivariant Graph Neural NetworksJiaqi Han, Wenbing Huang, Hengbo Ma, Jiachen Li et al.NeurIPS 2022 · 72 citations
Builds on9
- Strategies for Pre-training Graph Neural NetworksWeihua Hu, Bowen Liu, Joseph Gomes, Marinka Zitnik et al.ICLR 2020 · 1,744 citations
- DeepGCNs: Can GCNs Go As Deep As CNNs?Guohao Li, Matthias Müller, Ali K. Thabet, Bernard GhanemICCV 2019 · 1,586 citations
- Can Graph Neural Networks Count Substructures?Zhengdao Chen, Lei Chen, Soledad Villar, Joan BrunaNeurIPS 2020 · 392 citations
- Generalization and Representational Limits of Graph Neural NetworksVikas K. Garg, Stefanie Jegelka, Tommi S. JaakkolaICML 2020 · 363 citations
- A Practical Method for Constructing Equivariant Multilayer Perceptrons for Arbitrary Matrix GroupsMarc Finzi, Max Welling, Andrew Gordon WilsonICML 2021 · 226 citations
Related papers
- Schur Nets: exploiting local structure for equivariance in higher order graph neural networksQingqi Zhang, Ruize Xu, Risi KondorNeurIPS 2024 · 3 citations
- Approximately Equivariant Graph NetworksNingyuan Huang, Ron Levie, Soledad VillarNeurIPS 2023 · 29 citations
- Natural Graph NetworksPim de Haan, Taco S. Cohen, Max WellingNeurIPS 2020 · 53 citations
- Building powerful and equivariant graph neural networks with structural message-passingClément Vignac, Andreas Loukas, Pascal FrossardNeurIPS 2020 · 141 citations
- Equivariant Networks for Crystal StructuresSékou-Oumar Kaba, Siamak RavanbakhshNeurIPS 2022 · 38 citations
