Data Augmentation for Graph Neural Networks
Tong Zhao, Yozen Liu, Leonardo Neves, Oliver J. Woodford, Meng Jiang, Neil Shah
Abstract
Data augmentation has been widely used to improve generalizability of machine learning models. However, comparatively little work studies data augmentation for graphs. This is largely due to the complex, non-Euclidean structure of graphs, which limits possible manipulation operations. Augmentation operations commonly used in vision and language have no analogs for graphs. Our work studies graph data augmentation for graph neural networks (GNNs) in the context of improving semi-supervised node-classification. We discuss practical and theoretical motivations, considerations and strategies for graph data augmentation. Our work shows that neural edge predictors can effectively encode class-homophilic structure to promote intra-class edges and demote inter-class edges in given graph structure, and our main contribution introduces the GAug graph data augmentation framework, which leverages these insights to improve performance in GNN-based node classification via edge prediction. Extensive experiments on multiple benchmarks show that augmentation via GAug improves performance across GNN architectures and datasets.
Ask about this paper
Your agent reads all of it.
Lune indexed this paper to the last equation, along with the top-tier papers that cite it. Ask a question and the answer quotes them.
Your agent calls
Luneget_paper_fulltext
Free to start. No credit card required.
Terminal
Install the CLIlune papers fulltext 1e76cf5c-4daf-4ec3-a9f6-34f65b80afc4Cited by top-tier papers90
- Graph Contrastive Learning AutomatedYuning You, Tianlong Chen, Yang Shen, Zhangyang WangICML 2021 · 604 citations
- Sequential Recommendation with Graph Neural NetworksJianxin Chang, Chen Gao, Yu Zheng, Yiqun Hui et al.SIGIR 2021 · 435 citations
- Is Homophily a Necessity for Graph Neural Networks?Yao Ma, Xiaorui Liu, Neil Shah, Jiliang TangICLR 2022 · 295 citations
- Augmentation-Free Self-Supervised Learning on GraphsNamkyeong Lee, Junseok Lee, Chanyoung ParkAAAI 2022 · 288 citations
- InfoGCL: Information-Aware Graph Contrastive LearningDongkuan Xu, Wei Cheng, Dongsheng Luo, Haifeng Chen et al.NeurIPS 2021 · 261 citations
Builds on7
- Random Erasing Data AugmentationZhun Zhong, Liang Zheng, Guoliang Kang, Shaozi Li et al.AAAI 2020 · 4,134 citations
- Open Graph Benchmark: Datasets for Machine Learning on GraphsWeihua Hu, Matthias Fey, Marinka Zitnik, Yuxiao Dong et al.NeurIPS 2020 · 3,935 citations
- Unsupervised Data Augmentation for Consistency TrainingQizhe Xie, Zihang Dai, Eduard H. Hovy, Thang Luong et al.NeurIPS 2020 · 2,774 citations
- DropEdge: Towards Deep Graph Convolutional Networks on Node ClassificationYu Rong, Wenbing Huang, Tingyang Xu, Junzhou HuangICLR 2020 · 1,599 citations
- DeepGCNs: Can GCNs Go As Deep As CNNs?Guohao Li, Matthias Müller, Ali K. Thabet, Bernard GhanemICCV 2019 · 1,586 citations
Related papers
- NodeAug: Semi-Supervised Node Classification with Data AugmentationYiwei Wang, Wei Wang, Yuxuan Liang, Yujun Cai et al.KDD 2020 · 123 citations
- Metropolis-Hastings Data Augmentation for Graph Neural NetworksHyeon-Jin Park, Seunghun Lee, Sihyeon Kim, Jinyoung Park et al.NeurIPS 2021 · 65 citations
- G-Mixup: Graph Data Augmentation for Graph ClassificationXiaotian Han, Zhimeng Jiang, Ninghao Liu, Xia HuICML 2022 · 251 citations
- Label-invariant Augmentation for Semi-Supervised Graph ClassificationHan Yue, Chunhui Zhang, Chuxu Zhang, Hongfu LiuNeurIPS 2022 · 37 citations
- Automated Data Augmentations for Graph ClassificationYouzhi Luo, Michael McThrow, Wing Yee Au, Tao Komikado et al.ICLR 2023 · 8 citations
