SpeAr: A Spectral Approach for Zero-Shot Node Classification
Ting Guo, Da Wang, Jiye Liang, Kaihan Zhang, Jianchao Zeng
Abstract
Zero-shot node classification is a vital task in the field of graph data processing, aiming to identify nodes of classes unseen during the training process. Prediction bias is one of the primary challenges in zero-shot node classification, referring to the model’s propensity to misclassify nodes of unseen classes as seen classes. However, most methods introduce external knowledge to mitigate the bias, inadequately leveraging the inherent cluster information within the unlabeled nodes. To address this issue, we employ spectral analysis coupled with learnable class prototypes to discover the implicit cluster structures within the graph, providing a more comprehensive understanding of classes. In this paper, we propose a Spe ctral A pp r oach for zero-shot node classification (SpeAr). Specifically, we establish an approximate relationship between minimizing the spectral contrastive loss and performing spectral decomposition on the graph, thereby enabling effective node characterization through loss minimization. Subsequently, the class prototypes are iteratively refined based on the learned node representations, initialized with the semantic vectors. Finally, extensive experiments verify the effectiveness of the SpeAr, which can further alleviate the bias problem.
Ask about this paper
Your agent reads all of it.
Lune indexed this paper to the last equation, along with the top-tier papers that cite it. Ask a question and the answer quotes them.
Your agent calls
Luneget_paper_fulltext
Free to start. No credit card required.
Terminal
Install the CLIlune papers fulltext efb25b65-37aa-4d4e-bbad-f832856da084Cited by top-tier papers1
Ask how each one uses itBuilds on11
- Open Graph Benchmark: Datasets for Machine Learning on GraphsWeihua Hu, Matthias Fey, Marinka Zitnik, Yuxiao Dong et al.NeurIPS 2020 · 3,935 citations
- NodeFormer: A Scalable Graph Structure Learning Transformer for Node ClassificationQitian Wu, Wentao Zhao, Zenan Li, David P. Wipf et al.NeurIPS 2022 · 472 citations
- Provable Guarantees for Self-Supervised Deep Learning with Spectral Contrastive LossJeff Z. HaoChen, Colin Wei, Adrien Gaidon, Tengyu MaNeurIPS 2021 · 425 citations
- Zero-shot Node Classification with Decomposed Graph Prototype NetworkZheng Wang, Jialong Wang, Yuchen Guo, Zhiguo GongKDD 2021 · 41 citations
- A Graph-Theoretic Framework for Understanding Open-World Semi-Supervised LearningYiyou Sun, Zhenmei Shi, Yixuan LiNeurIPS 2023 · 38 citations
Related papers
- Graph Knows Unknowns: Reformulate Zero-Shot Learning as Sample-Level Graph RecognitionJingcai Guo, Song Guo, Qihua Zhou, Ziming Liu et al.AAAI 2023 · 42 citations
- Contrastive Meta-Learning for Few-shot Node ClassificationSong Wang, Zhen Tan, Huan Liu, Jundong LiKDD 2023 · 20 citations
- Unsupervised Episode Generation for Graph Meta-learningJihyeong Jung, Sangwoo Seo, Sungwon Kim, Chanyoung ParkICML 2024 · 4 citations
- JointCL: A Joint Contrastive Learning Framework for Zero-Shot Stance DetectionBin Liang, Qinglin Zhu, Xiang Li, Min Yang et al.ACL 2022 · 117 citations
- Geometer: Graph Few-Shot Class-Incremental Learning via Prototype RepresentationBin Lu, Xiaoying Gan, Lina Yang, Weinan Zhang et al.KDD 2022 · 18 citations
