KGCRR: An Effective Metric-Driven Knowledge Graph Completion Framework by Designing a Novel Upper Bound Function with Adaptive Approximation to Reciprocal Rank
Kuan Xu, Kuo Yang, Jian Liu, Xiangkui Lu, Jun Wu, Xuezhong Zhou
Abstract
Knowledge Graph Embedding (KGE) methods have achieved great success in predicting missing links in knowledge graphs, a task also known as Knowledge Graph Completion (KGC). Under this task, the Reciprocal Rank (RR) of ground-truth items serve as a key indicator for evaluating the method's performance. However, most existing studies have overlooked the inconsistency between the ranking metric, RR, and the optimization objective functions, resulting in sub-optimal KGC performance. To address this issue, we propose a KGC framework called KGCRR, which introduces an objective function named CRR that serves as an upper bound to RR. By introducing the parameter-pressure ρ to adjust the sigmoid function, CRR achieves a better approximation to RR compared to existing objective functions. We theoretically prove that by adjusting ρ, CRR can achieve a more effective approximation to RR. By narrowing the discrepancy with RR and alleviating the gradient vanishing issue associated with the direct optimization of RR loss, CRR demonstrates an advantage in optimizing RR. CRR serves as a plug-and-play objective, capable of seamless integration into various KGE methods. Through extensive experiments conducted on FB15k-237 and WN18RR datasets, we have obtained promising results, with an average improvement of 19.06% in MRR, indicating that CRR significantly enhances the performance of existing methods.
Ask about this paper
Your agent reads all of it.
Lune indexed this paper to the last equation, along with the top-tier papers that cite it. Ask a question and the answer quotes them.
Builds on5
- How Does Knowledge Graph Embedding Extrapolate to Unseen Data: A Semantic Evidence ViewRen Li, Yanan Cao, Qiannan Zhu, Guanqun Bi et al.AAAI 2022 · 103 citations
- Compounding Geometric Operations for Knowledge Graph CompletionXiou Ge, Yun-Cheng Wang, Bin Wang, C.-C. Jay KuoACL 2023 · 25 citations
- AUC Optimization with a Reject OptionSong-Qing Shen, Bin-Bin Yang, Wei GaoAAAI 2020 · 7 citations
- PairRE: Knowledge Graph Embeddings via Paired Relation VectorsLinlin Chao, Jianshan He, Taifeng Wang, Wei ChuACL 2021
- Optimizing Rank-Based Metrics With Blackbox DifferentiationMichal Rolínek, Vít Musil, Anselm Paulus, Marin Vlastelica P. et al.CVPR 2020
Related papers
- Analogical Inference Enhanced Knowledge Graph EmbeddingZhen Yao, Wen Zhang, Mingyang Chen, Yufeng Huang et al.AAAI 2023 · 21 citations
- CAKE: A Scalable Commonsense-Aware Framework For Multi-View Knowledge Graph CompletionGuanglin Niu, Bo Li, Yongfei Zhang, Shiliang PuACL 2022 · 56 citations
- Rethinking Knowledge Graph Evaluation Under the Open-World AssumptionHaotong Yang, Zhouchen Lin, Muhan ZhangNeurIPS 2022 · 30 citations
- KRACL: Contrastive Learning with Graph Context Modeling for Sparse Knowledge Graph CompletionZhaoxuan Tan, Zilong Chen, Shangbin Feng, Qingyue Zhang et al.WWW 2023 · 50 citations
- SimKGC: Simple Contrastive Knowledge Graph Completion with Pre-trained Language ModelsLiang Wang, Wei Zhao, Zhuoyu Wei, Jingming LiuACL 2022
