Relative and Absolute Location Embedding for Few-Shot Node Classification on Graph
Zemin Liu, Yuan Fang, Chenghao Liu, Steven C. H. Hoi
Abstract
Node classification is an important problem on graphs. While recent advances in graph neural networks achieve promising performance, they require abundant labeled nodes for training. However, in many practical scenarios, there often exist novel classes in which only one or a few labeled nodes are available as supervision, known as few-shot node classification. Although meta-learning has been widely used in vision and language domains to address few-shot learning, its adoption on graphs has been limited. In particular, graph nodes in a few-shot task are not independent and relate to each other. To deal with this, we propose a novel model called Relative and Absolute Location Embedding (RALE) hinged on the concept of hub nodes. Specifically, RALE captures the task-level dependency by assigning each node a relative location within a task, as well as the graph-level dependency by assigning each node an absolute location on the graph to further align different tasks toward learning a transferable prior. Finally, extensive experiments on three public datasets demonstrate the state-of-the-art performance of RALE.
Ask about this paper
Your agent reads all of it.
Lune indexed this paper to the last equation, along with the top-tier papers that cite it. Ask a question and the answer quotes them.
Cited by top-tier papers21
- GraphPrompt: Unifying Pre-Training and Downstream Tasks for Graph Neural NetworksZemin Liu, Xingtong Yu, Yuan Fang, Xinming ZhangWWW 2023 · 263 citations
- Spatio-Temporal Graph Few-Shot Learning with Cross-City Knowledge TransferBin Lu, Xiaoying Gan, Weinan Zhang, Huaxiu Yao et al.KDD 2022 · 82 citations
- HGPrompt: Bridging Homogeneous and Heterogeneous Graphs for Few-Shot Prompt LearningXingtong Yu, Yuan Fang, Zemin Liu, Xinming ZhangAAAI 2024 · 68 citations
- MultiGPrompt for Multi-Task Pre-Training and Prompting on GraphsXingtong Yu, Chang Zhou, Yuan Fang, Xinming ZhangWWW 2024 · 65 citations
- Virtual Node Tuning for Few-shot Node ClassificationZhen Tan, Ruocheng Guo, Kaize Ding, Huan LiuKDD 2023 · 61 citations
Builds on6
- Geom-GCN: Geometric Graph Convolutional NetworksHongbin Pei, Bingzhe Wei, Kevin Chen-Chuan Chang, Yu Lei et al.ICLR 2020 · 1,445 citations
- Few-Shot Knowledge Graph CompletionChuxu Zhang, Huaxiu Yao, Chao Huang, Meng Jiang et al.AAAI 2020 · 238 citations
- Graph Few-Shot Learning via Knowledge TransferHuaxiu Yao, Chuxu Zhang, Ying Wei, Meng Jiang et al.AAAI 2020 · 193 citations
- Measuring and Improving the Use of Graph Information in Graph Neural NetworksYifan Hou, Jie Zhang, James Cheng, Kaili Ma et al.ICLR 2020 · 148 citations
- Few-Shot Learning on graphs via super-Classes based on Graph spectral MeasuresJatin Chauhan, Deepak Nathani, Manohar KaulICLR 2020 · 77 citations
Related papers
- Node Classification on Graphs with Few-Shot Novel Labels via Meta Transformed Network EmbeddingLin Lan, Pinghui Wang, Xuefeng Du, Kaikai Song et al.NeurIPS 2020 · 50 citations
- Task-Equivariant Graph Few-shot LearningSungwon Kim, Junseok Lee, Namkyeong Lee, Wonjoong Kim et al.KDD 2023 · 9 citations
- Contrastive Meta-Learning for Few-shot Node ClassificationSong Wang, Zhen Tan, Huan Liu, Jundong LiKDD 2023 · 20 citations
- Few-shot Heterogeneous Graph Learning via Cross-domain Knowledge TransferQiannan Zhang, Xiaodong Wu, Qiang Yang, Chuxu Zhang et al.KDD 2022 · 21 citations
- Few-shot Node Classification on Attributed Networks with Graph Meta-learningYonghao Liu, Mengyu Li, Ximing Li, Fausto Giunchiglia et al.SIGIR 2022 · 33 citations
