Task-Adaptive Few-shot Node Classification
Song Wang, Kaize Ding, Chuxu Zhang, Chen Chen, Jundong Li
Abstract
Node classification is of great importance among various graph mining tasks. In practice, real-world graphs generally follow the long-tail distribution, where a large number of classes only consist of limited labeled nodes. Although Graph Neural Networks (GNNs) have achieved significant improvements in node classification, their performance decreases substantially in such a few-shot scenario. The main reason can be attributed to the vast generalization gap between meta-training and meta-test due to the task variance caused by different node/class distributions in meta-tasks (i.e., node-level and class-level variance). Therefore, to effectively alleviate the impact of task variance, we propose a task-adaptive node classification framework under the few-shot learning setting. Specifically, we first accumulate meta-knowledge across classes with abundant labeled nodes. Then we transfer such knowledge to the classes with limited labeled nodes via our proposed task-adaptive modules. In particular, to accommodate the different node/class distributions among meta-tasks, we propose three essential modules to perform node-level, class-level, and task-level adaptations in each meta-task, respectively. In this way, our framework can conduct adaptations to different meta-tasks and thus advance the model generalization performance on meta-test tasks. Extensive experiments on four prevalent node classification datasets demonstrate the superiority of our framework over the state-of-the-art baselines. Our code is provided at https://github.com/SongW-SW/TENT https://github.com/SongW-SW/TENT.
Ask about this paper
Your agent reads all of it.
Lune indexed this paper to the last equation, along with the top-tier papers that cite it. Ask a question and the answer quotes them.
Your agent calls
Luneget_paper_fulltext
Free to start. No credit card required.
Terminal
Install the CLIlune papers fulltext 6ad29e93-a836-490a-ac73-b9fa8b117eddCited by top-tier papers25
- One For All: Towards Training One Graph Model For All Classification TasksHao Liu, Jiarui Feng, Lecheng Kong, Ningyue Liang et al.ICLR 2024 · 253 citations
- PRODIGY: Enabling In-context Learning Over GraphsQian Huang, Hongyu Ren, Peng Chen, Gregor Krzmanc et al.NeurIPS 2023 · 131 citations
- GFT: Graph Foundation Model with Transferable Tree VocabularyZehong Wang, Zheyuan Zhang, Nitesh V. Chawla, Chuxu Zhang et al.NeurIPS 2024 · 108 citations
- Virtual Node Tuning for Few-shot Node ClassificationZhen Tan, Ruocheng Guo, Kaize Ding, Huan LiuKDD 2023 · 61 citations
- RAGraph: A General Retrieval-Augmented Graph Learning FrameworkXinke Jiang, Rihong Qiu, Yongxin Xu, Wentao Zhang et al.NeurIPS 2024 · 42 citations
Builds on9
- Supervised Contrastive LearningPrannay Khosla, Piotr Teterwak, Chen Wang, Aaron Sarna et al.NeurIPS 2020 · 7,049 citations
- Open Graph Benchmark: Datasets for Machine Learning on GraphsWeihua Hu, Matthias Fey, Marinka Zitnik, Yuxiao Dong et al.NeurIPS 2020 · 3,935 citations
- Graph Meta Learning via Local SubgraphsKexin Huang, Marinka ZitnikNeurIPS 2020 · 205 citations
- Graph Few-Shot Learning via Knowledge TransferHuaxiu Yao, Chuxu Zhang, Ying Wei, Meng Jiang et al.AAAI 2020 · 193 citations
- Relative and Absolute Location Embedding for Few-Shot Node Classification on GraphZemin Liu, Yuan Fang, Chenghao Liu, Steven C. H. HoiAAAI 2021 · 103 citations
Related papers
- Task-Equivariant Graph Few-shot LearningSungwon Kim, Junseok Lee, Namkyeong Lee, Wonjoong Kim et al.KDD 2023 · 9 citations
- Graph Few-shot Learning with Task-specific StructuresSong Wang, Chen Chen, Jundong LiNeurIPS 2022 · 38 citations
- Contrastive Meta-Learning for Few-shot Node ClassificationSong Wang, Zhen Tan, Huan Liu, Jundong LiKDD 2023 · 20 citations
- Task Negative Sampling Enhanced Graph Few-shot LearningChenxu Wang, Jinfeng Chen, Junzhou Zhao, Pinghui WangKDD 2025
- Hybrid Graph Neural Networks for Few-Shot LearningTianyuan Yu, Sen He, Yi-Zhe Song, Tao XiangAAAI 2022 · 77 citations
