Interpolating Graph Pair to Regularize Graph Classification
Hongyu Guo, Yongyi Mao
Abstract
We present a simple and yet effective interpolation-based regularization technique, aiming to improve the generalization of Graph Neural Networks (GNNs) on supervised graph classification. We leverage Mixup (Zhang et al. 2018a), an effective regularizer for vision, where random sample pairs and their labels are interpolated to create synthetic images for training. Unlike images with grid-like coordinates, graphs have arbitrary structure and topology, which can be very sensitive to any modification that alters the graph's semantic meanings. This posts two unanswered questions for Mixup-like regularization schemes: Can we directly mix up a pair of graph inputs? If so, how well does such mixing strategy regularize the learning of GNNs? To answer these two questions, we propose ifMixup, which first adds dummy nodes to make two graphs have the same input size and then simultaneously performs linear interpolation between the aligned node feature vectors and the aligned edge representations of the two graphs. We empirically show that such simple mixing schema can effectively regularize the classification learning, resulting in superior predictive accuracy to popular graph augmentation and GNN methods.
Ask about this paper
Your agent reads all of it.
Lune indexed this paper to the last equation, along with the top-tier papers that cite it. Ask a question and the answer quotes them.
Your agent calls
Luneget_paper_fulltext
Free to start. No credit card required.
Terminal
Install the CLIlune papers fulltext 08ee1c59-a668-438b-801d-5a63b7a8ffdcCited by top-tier papers2
- A Graph is Worth K Words: Euclideanizing Graph using Pure TransformerZhangyang Gao, Daize Dong, Cheng Tan, Jun Xia et al.ICML 2024 · 9 citations
- Is Graph Mixup Beneficial? Investigating Interpolation And Empirical Performance of Graph Mixup MethodsSimon Forbat, Rainer GemullaICML 2026
Builds on15
- Open Graph Benchmark: Datasets for Machine Learning on GraphsWeihua Hu, Matthias Fey, Marinka Zitnik, Yuxiao Dong et al.NeurIPS 2020 · 3,935 citations
- Graph Contrastive Learning with AugmentationsYuning You, Tianlong Chen, Yongduo Sui, Ting Chen et al.NeurIPS 2020 · 3,042 citations
- How Attentive are Graph Attention Networks?Shaked Brody, Uri Alon, Eran YahavICLR 2022 · 1,717 citations
- DropEdge: Towards Deep Graph Convolutional Networks on Node ClassificationYu Rong, Wenbing Huang, Tingyang Xu, Junzhou HuangICLR 2020 · 1,599 citations
- DeepGCNs: Can GCNs Go As Deep As CNNs?Guohao Li, Matthias Müller, Ali K. Thabet, Bernard GhanemICCV 2019 · 1,586 citations
Related papers
- Mixup for Node and Graph ClassificationYiwei Wang, Wei Wang, Yuxuan Liang, Yujun Cai et al.WWW 2021 · 220 citations
- G-Mixup: Graph Data Augmentation for Graph ClassificationXiaotian Han, Zhimeng Jiang, Ninghao Liu, Xia HuICML 2022 · 251 citations
- iGraphMix: Input Graph Mixup Method for Node ClassificationJongwon Jeong, Hoyeop Lee, Hyui Geon Yoon, Beomyoung Lee et al.ICLR 2024 · 10 citations
- GraphMix: Improved Training of GNNs for Semi-Supervised LearningVikas Verma, Meng Qu, Kenji Kawaguchi, Alex Lamb et al.AAAI 2021 · 157 citations
- IntraMix: Intra-Class Mixup Generation for Accurate Labels and NeighborsShenghe Zheng, Hongzhi Wang, Xianglong LiuNeurIPS 2024 · 11 citations
