Conformal Path Reasoning: Trustworthy Knowledge Graph Question Answering via Path-Level Calibration
Shuhang Lin, Chuhao Zhou, Xiao Lin, Zihan Dong, Kuan Lu, Zhencan Peng, Jie Yin, Dimitris Metaxas
摘要
Knowledge Graph Question Answering (KGQA) offers grounded, interpretable reasoning, but existing methods often fail to provide reliable coverage guarantees over retrieved answers. While Conformal Prediction (CP) offers a principled framework for producing prediction sets with statistical guarantees, prior conformal KGQA methods suffer from two critical pitfalls: violated coverage guarantees due to invalid calibration, and weak score discriminability that yields excessively large prediction sets. We propose Conformal Path Reasoning (CPR) 1 , a novel trustworthy KGQA framework built on two key innovations. First, query-level conformal calibration over path-level scores preserves exchangeability to ensure valid coverage guarantees. Second, we introduce the Residual Conformal Value Network (RCVNet), a lightweight module trained via PUCT-guided exploration to learn discriminative path-level nonconformity scores. Extensive experiments show that CPR significantly improves the Empirical Coverage Rate by 45% while reducing prediction set size by 52% on average over conformal baselines across benchmark datasets, highlighting its effectiveness for reliable conformal reasoning over knowledge graphs.
问问这篇 Paper
智能体会读完全文。
Lune 把这篇 Paper 索引到了每一个公式,引用它的顶会 Paper 也一样。你提问,回答直接引用原文。
它引用的顶会 Paper8
- Reasoning on Graphs: Faithful and Interpretable Large Language Model ReasoningLinhao Luo, Yuan-Fang Li, Gholamreza Haffari, Shirui PanICLR 2024 · 被引用 499 次
- Beta Embeddings for Multi-Hop Logical Reasoning in Knowledge GraphsHongyu Ren, Jure LeskovecNeurIPS 2020 · 被引用 267 次
- Conformal Language ModelingVictor Quach, Adam Fisch, Tal Schuster, Adam Yala 等ICLR 2024 · 被引用 132 次
- Uncertainty Quantification over Graph with Conformalized Graph Neural NetworksKexin Huang, Ying Jin, Emmanuel J. Candès, Jure LeskovecNeurIPS 2023 · 被引用 124 次
- Paths-over-Graph: Knowledge Graph Empowered Large Language Model ReasoningXingyu Tan, Xiaoyang Wang, Qing Liu, Xiwei Xu 等WWW 2025 · 被引用 86 次
相关 Paper
- Towards Trustworthy Knowledge Graph Reasoning: An Uncertainty Aware PerspectiveBo Ni, Yu Wang, Lu Cheng, Erik Blasch 等AAAI 2025 · 被引用 18 次
- Inference-Time Conformal Reasoning with Valid Factuality Control for Large Language ModelsTing Wang, Yuanjie Shi, Yan Yan, Huan ZhangICML 2026
- Quantifying and Understanding Uncertainty in Large Reasoning ModelsYangyi Li, Chenxu Zhao, Mengdi HuaiACL 2026
- Certainty in Uncertainty: Reasoning over Uncertain Knowledge Graphs with Statistical GuaranteesYuqicheng Zhu, Jingcheng Wu, Yizhen Wang, Hongkuan Zhou 等EMNLP 2025
- COLEP: Certifiably Robust Learning-Reasoning Conformal Prediction via Probabilistic CircuitsMintong Kang, Nezihe Merve Gürel, Linyi Li, Bo LiICLR 2024 · 被引用 12 次
