Graph Meta Learning via Local Subgraphs
Kexin Huang, Marinka Zitnik
Abstract
Prevailing methods for graphs require abundant label and edge information for learning. When data for a new task are scarce, meta learning can learn from prior experiences and form much-needed inductive biases for fast adaption to new tasks. Here, we introduce G-META, a novel meta-learning algorithm for graphs. G-META uses local subgraphs to transfer subgraph-specific information and learn transferable knowledge faster via meta gradients. G-META learns how to quickly adapt to a new task using only a handful of nodes or edges in the new task and does so by learning from data points in other graphs or related, albeit disjoint, label sets. G-META is theoretically justified as we show that the evidence for a prediction can be found in the local subgraph surrounding the target node or edge. Experiments on seven datasets and nine baseline methods show that G-META outperforms existing methods by up to 16.3%. Unlike previous methods, G-META successfully learns in challenging, few-shot learning settings that require generalization to completely new graphs and never-before-seen labels. Finally, G-META scales to large graphs, which we demonstrate on a new Tree-of-Life dataset comprising 1,840 graphs, a two-orders of magnitude increase in the number of graphs used in prior work. 34th Conference on Neural Information Processing Systems (NeurIPS 2020),
Ask about this paper
Your agent reads all of it.
Lune indexed this paper to the last equation, along with the top-tier papers that cite it. Ask a question and the answer quotes them.
Your agent calls
Luneget_paper_fulltext
Free to start. No credit card required.
Terminal
Install the CLIlune papers fulltext a07d2aa8-9697-4b33-b60f-2380d90ba4d6Cited by top-tier papers54
- GraphPrompt: Unifying Pre-Training and Downstream Tasks for Graph Neural NetworksZemin Liu, Xingtong Yu, Yuan Fang, Xinming ZhangWWW 2023 · 263 citations
- InfoGCL: Information-Aware Graph Contrastive LearningDongkuan Xu, Wei Cheng, Dongsheng Luo, Haifeng Chen et al.NeurIPS 2021 · 261 citations
- Nested Graph Neural NetworksMuhan Zhang, Pan LiNeurIPS 2021 · 213 citations
- From Stars to Subgraphs: Uplifting Any GNN with Local Structure AwarenessLingxiao Zhao, Wei Jin, Leman Akoglu, Neil ShahICLR 2022 · 213 citations
- PRODIGY: Enabling In-context Learning Over GraphsQian Huang, Hongyu Ren, Peng Chen, Gregor Krzmanc et al.NeurIPS 2023 · 131 citations
Builds on8
- Open Graph Benchmark: Datasets for Machine Learning on GraphsWeihua Hu, Matthias Fey, Marinka Zitnik, Yuxiao Dong et al.NeurIPS 2020 · 3,935 citations
- GraphSAINT: Graph Sampling Based Inductive Learning MethodHanqing Zeng, Hongkuan Zhou, Ajitesh Srivastava, Rajgopal Kannan et al.ICLR 2020 · 1,155 citations
- Meta-Dataset: A Dataset of Datasets for Learning to Learn from Few ExamplesEleni Triantafillou, Tyler Zhu, Vincent Dumoulin, Pascal Lamblin et al.ICLR 2020 · 692 citations
- Inductive Relation Prediction by Subgraph ReasoningKomal K. Teru, Etienne G. Denis, William L. HamiltonICML 2020 · 493 citations
- Graph Few-Shot Learning via Knowledge TransferHuaxiu Yao, Chuxu Zhang, Ying Wei, Meng Jiang et al.AAAI 2020 · 193 citations
Related papers
- Hyperbolic Graph Neural Networks at Scale: A Meta Learning ApproachNurendra Choudhary, Nikhil Rao, Chandan K. ReddyNeurIPS 2023 · 17 citations
- Task-Equivariant Graph Few-shot LearningSungwon Kim, Junseok Lee, Namkyeong Lee, Wonjoong Kim et al.KDD 2023 · 9 citations
- Node Classification on Graphs with Few-Shot Novel Labels via Meta Transformed Network EmbeddingLin Lan, Pinghui Wang, Xuefeng Du, Kaikai Song et al.NeurIPS 2020 · 50 citations
- Unlocking the Potential of Black-box Pre-trained GNNs for Graph Few-shot LearningQiannan Zhang, Shichao Pei, Yuan Fang, Xiangliang ZhangAAAI 2025 · 1 citation
- MetaGL: Evaluation-Free Selection of Graph Learning Models via Meta-LearningNamyong Park, Ryan A. Rossi, Nesreen K. Ahmed, Christos FaloutsosICLR 2023 · 1 citation
