Certainty in Uncertainty: Reasoning over Uncertain Knowledge Graphs with Statistical Guarantees
Yuqicheng Zhu, Jingcheng Wu, Yizhen Wang, Hongkuan Zhou, Jiaoyan Chen, Evgeny Kharlamov, Steffen Staab
Abstract
Uncertain knowledge graph embedding (Un-KGE) methods learn vector representations that capture both structural and uncertainty information to predict scores of unseen triples. However, existing methods produce only point estimates, without quantifying predictive uncertainty-limiting their reliability in high-stakes applications where understanding confidence in predictions is crucial. To address this limitation, we propose UNKGCP, a framework that generates prediction intervals guaranteed to contain the true score with a user-specified level of confidence. The length of the intervals reflects the model's predictive uncertainty. UNKGCP builds on the conformal prediction framework but introduces a novel nonconformity measure tailored to UnKGE methods and an efficient procedure for interval construction. We provide theoretical guarantees for the intervals and empirically verify these guarantees. Extensive experiments on standard benchmarks across diverse UnKGE methods further demonstrate that the intervals are sharp and effectively capture predictive uncertainty. To support future research on this topic, we release our code 1 .
Ask about this paper
Your agent reads all of it.
Lune indexed this paper to the last equation, along with the top-tier papers that cite it. Ask a question and the answer quotes them.
Cited by top-tier papers1
Ask how each one uses itBuilds on6
- Probability Calibration for Knowledge Graph Embedding ModelsPedro Tabacof, Luca CostabelloICLR 2020 · 49 citations
- Conformal Prediction Sets for Graph Neural NetworksSoroush H. Zargarbashi, Simone Antonelli, Aleksandar BojchevskiICML 2023 · 49 citations
- PASSLEAF: A Pool-bAsed Semi-Supervised LEArning Framework for Uncertain Knowledge Graph EmbeddingZhu-Mu Chen, Mi-Yen Yeh, Tei-Wei KuoAAAI 2021 · 27 citations
- Conformal Inductive Graph Neural NetworksSoroush H. Zargarbashi, Aleksandar BojchevskiICLR 2024 · 15 citations
- MultiADS: Defect-Aware Supervision for Multi-Type Anomaly Detection and Segmentation in Zero-Shot LearningYlli Sadikaj, Hongkuan Zhou, Lavdim Halilaj, Stefan Schmid et al.ICCV 2025 · 6 citations
Related papers
- Uncertainty Quantification over Graph with Conformalized Graph Neural NetworksKexin Huang, Ying Jin, Emmanuel J. Candès, Jure LeskovecNeurIPS 2023 · 124 citations
- Enhancing Trustworthiness of Graph Neural Networks with Rank-Based Conformal TrainingTing Wang, Zhixin Zhou, Rui LuoAAAI 2025 · 12 citations
- Conformalized Link Prediction on Graph Neural NetworksTianyi Zhao, Jian Kang, Lu ChengKDD 2024 · 9 citations
- Towards Trustworthy Knowledge Graph Reasoning: An Uncertainty Aware PerspectiveBo Ni, Yu Wang, Lu Cheng, Erik Blasch et al.AAAI 2025 · 18 citations
- ReliK: A Reliability Measure for Knowledge Graph EmbeddingsMaximilian K. Egger, Wenyue Ma, Davide Mottin, Panagiotis Karras et al.WWW 2024 · 2 citations
