Normalizing Flow-based Neural Process for Few-Shot Knowledge Graph Completion
Linhao Luo, Yuan-Fang Li, Gholamreza Haffari, Shirui Pan
Abstract
Knowledge graphs (KGs), as a structured form of knowledge representation, have been widely applied in the real world. Recently, few-shot knowledge graph completion (FKGC), which aims to predict missing facts for unseen relations with few-shot associated facts, has attracted increasing attention from practitioners and researchers. However, existing FKGC methods are based on metric learning or meta-learning, which often suffer from the out-of-distribution and overfitting problems. Meanwhile, they are incompetent at estimating uncertainties in predictions, which is critically important as model predictions could be very unreliable in few-shot settings. Furthermore, most of them cannot handle complex relations and ignore path information in KGs, which largely limits their performance. In this paper, we propose a normalizing flow-based neural process for few-shot knowledge graph completion (NP-FKGC). Specifically, we unify normalizing flows and neural processes to model a complex distribution of KG completion functions. This offers a novel way to predict facts for few-shot relations while estimating the uncertainty. Then, we propose a stochastic ManifoldE decoder to incorporate the neural process and handle complex relations in few-shot settings. To further improve performance, we introduce an attentive relation path-based graph neural network to capture path information in KGs. Extensive experiments on three public datasets demonstrate that our method significantly outperforms the existing FKGC methods and achieves state-of-the-art performance. Code is available at https://github.com/RManLuo/NP-FKGC.git.
Ask about this paper
Your agent reads all of it.
Lune indexed this paper to the last equation, along with the top-tier papers that cite it. Ask a question and the answer quotes them.
Your agent calls
Luneget_paper_fulltext
Free to start. No credit card required.
Terminal
Install the CLIlune papers fulltext c7d558d9-16e7-470d-aac1-0778d4d33861Cited by top-tier papers11
- Reasoning on Graphs: Faithful and Interpretable Large Language Model ReasoningLinhao Luo, Yuan-Fang Li, Gholamreza Haffari, Shirui PanICLR 2024 · 499 citations
- Structure-free Graph Condensation: From Large-scale Graphs to Condensed Graph-free DataXin Zheng, Miao Zhang, Chunyang Chen, Quoc Viet Hung Nguyen et al.NeurIPS 2023 · 115 citations
- Finding the Missing-half: Graph Complementary Learning for Homophily-prone and Heterophily-prone GraphsYizhen Zheng, He Zhang, Vincent Cheng-Siong Lee, Yu Zheng et al.ICML 2023 · 51 citations
- Learning Strong Graph Neural Networks with Weak InformationYixin Liu, Kaize Ding, Jianling Wang, Vincent C. S. Lee et al.KDD 2023 · 40 citations
- GNNEvaluator: Evaluating GNN Performance On Unseen Graphs Without LabelsXin Zheng, Miao Zhang, Chunyang Chen, Soheila Molaei et al.NeurIPS 2023 · 30 citations
Builds on18
- Neural Bellman-Ford Networks: A General Graph Neural Network Framework for Link PredictionZhaocheng Zhu, Zuobai Zhang, Louis-Pascal A. C. Xhonneux, Jian TangNeurIPS 2021 · 546 citations
- Identity-aware Graph Neural NetworksJiaxuan You, Jonathan Michael Gomes Selman, Rex Ying, Jure LeskovecAAAI 2021 · 316 citations
- Few-Shot Knowledge Graph CompletionChuxu Zhang, Huaxiu Yao, Chao Huang, Meng Jiang et al.AAAI 2020 · 238 citations
- Federated Learning on Non-IID Graphs via Structural Knowledge SharingYue Tan, Yixin Liu, Guodong Long, Jing Jiang et al.AAAI 2023 · 224 citations
- Uncertainty-aware Self-training for Few-shot Text ClassificationSubhabrata Mukherjee, Ahmed Hassan AwadallahNeurIPS 2020 · 182 citations
Related papers
- Relational Learning with Gated and Attentive Neighbor Aggregator for Few-Shot Knowledge Graph CompletionGuanglin Niu, Yang Li, Chengguang Tang, Ruiying Geng et al.SIGIR 2021 · 90 citations
- Multi-Modal Siamese Network for Few-Shot Knowledge Graph CompletionYuyang Wei, Wei Chen, Xiaofang Zhang, Pengpeng Zhao et al.ICDE 2024 · 9 citations
- Adaptive Attentional Network for Few-Shot Knowledge Graph CompletionJiawei Sheng, Shu Guo, Zhenyu Chen, Juwei Yue et al.EMNLP 2020 · 117 citations
- Learning Inter-Entity-Interaction for Few-Shot Knowledge Graph CompletionYuling Li, Kui Yu, Xiaoling Huang, Yuhong ZhangEMNLP 2022 · 24 citations
- Hierarchical Relational Learning for Few-Shot Knowledge Graph CompletionHan Wu, Jie Yin, Bala Rajaratnam, Jianyuan GuoICLR 2023 · 9 citations
