Generalizing CNNs to graphs with learnable neighborhood quantization
Isaac Osafo Nkansah, Neil Gallagher, Ruchi Sandilya, Conor Liston, Logan Grosenick
Abstract
Convolutional neural networks (CNNs) have led to a revolution in analyzing array data. However, many important sources of data, such as biological and social networks, are naturally structured as graphs rather than arrays, making the design of graph neural network (GNN) architectures that retain the strengths of CNNs an active and exciting area of research. Here, we introduce Quantized Graph Convolution Networks (QGCNs), the first framework for GNNs that formally and directly extends CNNs to graphs. QGCNs do this by decomposing the convolution operation into non-overlapping sub-kernels, allowing them to fit graph data while reducing to a 2D CNN layer on array data. We generalize this approach to graphs of arbitrary size and dimension by approaching sub-kernel assignment as a learnable multinomial assignment problem. Integrating this approach into a residual network architecture, we demonstrate performance that matches or exceeds other state-of-the-art GNNs on benchmark graph datasets and for predicting properties of nonlinear dynamics on a new finite element graph dataset. In summary, QGCNs are a novel GNN framework that generalizes CNNs and their strengths to graph data, allowing for more accurate and expressive models.
Ask about this paper
Your agent reads all of it.
Lune indexed this paper to the last equation, along with the top-tier papers that cite it. Ask a question and the answer quotes them.
Your agent calls
Luneget_paper_fulltext
Free to start. No credit card required.
Terminal
Install the CLIlune papers fulltext f60f47ee-8ed1-4c9b-9fe5-8c675b70f126Builds on7
- How Attentive are Graph Attention Networks?Shaked Brody, Uri Alon, Eran YahavICLR 2022 · 1,717 citations
- DropEdge: Towards Deep Graph Convolutional Networks on Node ClassificationYu Rong, Wenbing Huang, Tingyang Xu, Junzhou HuangICLR 2020 · 1,599 citations
- DeepGCNs: Can GCNs Go As Deep As CNNs?Guohao Li, Matthias Müller, Ali K. Thabet, Bernard GhanemICCV 2019 · 1,586 citations
- PairNorm: Tackling Oversmoothing in GNNsLingxiao Zhao, Leman AkogluICLR 2020 · 590 citations
- KerGNNs: Interpretable Graph Neural Networks with Graph KernelsAosong Feng, Chenyu You, Shiqiang Wang, Leandros TassiulasAAAI 2022 · 111 citations
Related papers
- VQ-GNN: A Universal Framework to Scale up Graph Neural Networks using Vector QuantizationMucong Ding, Kezhi Kong, Jingling Li, Chen Zhu et al.NeurIPS 2021 · 68 citations
- Convolutional Kernel Networks for Graph-Structured DataDexiong Chen, Laurent Jacob, Julien MairalICML 2020 · 65 citations
- QGTC: accelerating quantized graph neural networks via GPU tensor coreYuke Wang, Boyuan Feng, Yufei DingPPoPP 2022 · 47 citations
- Digraph Inception Convolutional NetworksZekun Tong, Yuxuan Liang, Changsheng Sun, Xinke Li et al.NeurIPS 2020 · 132 citations
- Unifying and Improving Graph Convolutional Neural Networks with Wavelet Denoising FiltersLiangtian Wan, Xiaona Li, Huijin Han, Xiaoran Yan et al.WWW 2023 · 3 citations
