Can Pseudo-Label Be More Reliable? A Simple yet Effective Topology-Aware Graph Self-Training Method
Gen Liu, Zhongying Zhao, Hui Zhou, Chao Li, Qingtian Zeng
Abstract
Graph Neural Networks (GNNs) have demonstrated impressive success across a range of graph-based tasks. However, their performance in node classification typically relies on enough high-quality labeled data which are difficult to obtain in practice. Self-training emerges as a promising solution to tackle the issue of label scarcity. Most existing studies in this direction mainly rely on classification scores to explore high-confidence unlabeled samples. Nevertheless, these methods often lead to false positive samples, which hinders the capability of GNNs. To this end, we propose a simple yet effective Topology-Aware Graph Self-Training (TA-GST) method. Specifically, we first explore the origin of false positives in pseudo-labeled samples. We then design a topology-aware scoring method, which considers both the classification score and connectivity pattern to enhance the reliability of pseudo-labeled samples. Besides, we depart TA-GST from the traditional teacher-student pattern and simplify it in an end-to-end manner. Extensive experiments on seven real-world datasets demonstrate the effectiveness of our method.
Ask about this paper
Your agent reads all of it.
Lune indexed this paper to the last equation, along with the top-tier papers that cite it. Ask a question and the answer quotes them.
Your agent calls
Luneget_paper_fulltext
Free to start. No credit card required.
Terminal
Install the CLIlune papers fulltext 3dc751d0-7704-4ebf-b2f1-01f19f8dc63cBuilds on10
- Open Graph Benchmark: Datasets for Machine Learning on GraphsWeihua Hu, Matthias Fey, Marinka Zitnik, Yuxiao Dong et al.NeurIPS 2020 · 3,935 citations
- Rethinking Pre-training and Self-trainingBarret Zoph, Golnaz Ghiasi, Tsung-Yi Lin, Yin Cui et al.NeurIPS 2020 · 755 citations
- ST++: Make Self-trainingWork Better for Semi-supervised Semantic SegmentationLihe Yang, Wei Zhuo, Lei Qi, Yinghuan Shi et al.CVPR 2022 · 467 citations
- Multi-Stage Self-Supervised Learning for Graph Convolutional Networks on Graphs with Few Labeled NodesKe Sun, Zhouchen Lin, Zhanxing ZhuAAAI 2020 · 304 citations
- Uncertainty-aware Self-training for Few-shot Text ClassificationSubhabrata Mukherjee, Ahmed Hassan AwadallahNeurIPS 2020 · 182 citations
Related papers
- Confidence May Cheat: Self-Training on Graph Neural Networks under Distribution ShiftHongrui Liu, Binbin Hu, Xiao Wang, Chuan Shi et al.WWW 2022 · 66 citations
- Be Confident! Towards Trustworthy Graph Neural Networks via Confidence CalibrationXiao Wang, Hongrui Liu, Chuan Shi, Cheng YangNeurIPS 2021 · 158 citations
- TAM: Topology-Aware Margin Loss for Class-Imbalanced Node ClassificationJaeyun Song, Joonhyung Park, Eunho YangICML 2022 · 90 citations
- NRGNN: Learning a Label Noise Resistant Graph Neural Network on Sparsely and Noisily Labeled GraphsEnyan Dai, Charu Aggarwal, Suhang WangKDD 2021 · 80 citations
- Divide and Denoise: Empowering Simple Models for Robust Semi-Supervised Node Classification against Label NoiseKaize Ding, Xiaoxiao Ma, Yixin Liu, Shirui PanKDD 2024 · 8 citations
