A Multi-Scale Approach for Graph Link Prediction
Lei Cai, Shuiwang Ji
Abstract
Deep models can be made scale-invariant when trained with multi-scale information. Images can be easily made multi-scale, given their grid-like structures. Extending this to generic graphs poses major challenges. For example, in link prediction tasks, inputs are represented as graphs consisting of nodes and edges. Currently, the state-of-the-art model for link prediction uses supervised heuristic learning, which learns graph structure features centered on two target nodes. It then learns graph neural networks to predict the existence of links based on graph structure features. Thus, the performance of link prediction models highly depends on graph structure features. In this work, we propose a novel node aggregation method that can transform the enclosing subgraph into different scales and preserve the relationship between two target nodes for link prediction. A theory for analyzing the information loss during the re-scaling procedure is also provided. Graphs in different scales can provide scale-invariant information, which enables graph neural networks to learn invariant features and improve link prediction performance. Our experimental results on 14 datasets from different areas demonstrate that our proposed method outperforms the state-of-the-art methods by employing multi-scale graphs without additional parameters.
Ask about this paper
Your agent reads all of it.
Lune indexed this paper to the last equation, along with the top-tier papers that cite it. Ask a question and the answer quotes them.
Cited by top-tier papers16
- Towards Deeper Graph Neural NetworksMeng Liu, Hongyang Gao, Shuiwang JiKDD 2020 · 496 citations
- StructPool: Structured Graph Pooling via Conditional Random FieldsHao Yuan, Shuiwang JiICLR 2020 · 204 citations
- Learning from Counterfactual Links for Link PredictionTong Zhao, Gang Liu, Daheng Wang, Wenhao Yu et al.ICML 2022 · 127 citations
- Node Dependent Local Smoothing for Scalable Graph LearningWentao Zhang, Mingyu Yang, Zeang Sheng, Yang Li et al.NeurIPS 2021 · 87 citations
- PaSca: A Graph Neural Architecture Search System under the Scalable ParadigmWentao Zhang, Yu Shen, Zheyu Lin, Yang Li et al.WWW 2022 · 69 citations
Related papers
- Neo-GNNs: Neighborhood Overlap-aware Graph Neural Networks for Link PredictionSeongjun Yun, Seoyoon Kim, Junhyun Lee, Jaewoo Kang et al.NeurIPS 2021 · 183 citations
- MAGNN: Metapath Aggregated Graph Neural Network for Heterogeneous Graph EmbeddingXinyu Fu, Jiani Zhang, Ziqiao Meng, Irwin KingWWW 2020 · 1,149 citations
- ScaleNet - Improve CNNs through Recursively Rescaling ObjectsXingyi Li, Zhongang Qi, Xiaoli Z. Fern, Fuxin LiAAAI 2020 · 1 citation
- Going Deep: Graph Convolutional Ladder-Shape NetworksRuiqi Hu, Shirui Pan, Guodong Long, Qinghua Lu et al.AAAI 2020 · 28 citations
- Multi-level Hyperedge Distillation for Social Linking Prediction on Sparsely Observed NetworksXiangguo Sun, Hongzhi Yin, Bo Liu, Hongxu Chen et al.WWW 2021 · 50 citations
