Reasoning over Hierarchical Question Decomposition Tree for Explainable Question Answering
Jiajie Zhang, Shulin Cao, Tingjian Zhang, Xin Lv, Juanzi Li, Lei Hou, Jiaxin Shi, Qi Tian
Abstract
Explainable question answering (XQA) aims to answer a given question and provide an explanation why the answer is selected. Existing XQA methods focus on reasoning on a single knowledge source, e.g., structured knowledge bases, unstructured corpora, etc. However, integrating information from heterogeneous knowledge sources is essential to answer complex questions. In this paper, we propose to leverage question decomposing for heterogeneous knowledge integration, by breaking down a complex question into simpler ones, and selecting the appropriate knowledge source for each sub-question. To facilitate reasoning, we propose a novel two-stage XQA framework, Reasoning over Hierarchical Question Decomposition Tree (RoHT). First, we build the Hierarchical Question Decomposition Tree (HQDT) to understand the semantics of a complex question; then, we conduct probabilistic reasoning over HQDT from root to leaves recursively, to aggregate heterogeneous knowledge at different tree levels and search for a best solution considering the decomposing and answering probabilities. The experiments on complex QA datasets KQA Pro and Musique show that our framework outperforms SOTA methods significantly, demonstrating the effectiveness of leveraging question decomposing for knowledge integration and our RoHT framework. * Indicates equal contribution. โ Corresponding author. ๐ ๐ : Which is higher, the highest mountain in North America or the highest mountain in Africa? ๐ ๐ : How high is the highest mountain in North America? ๐ ๐ : How high is the highest mountain in Africa? ๐ ๐ : How high is #4? ๐ ๐ : Which mountain is the highest in Africa? ๐ ๐ : How high is #6? ๐ ๐ : Which mountain is the highest in North America? ๐ ๐ :[SelectBetween] [greater] #1 #2
Ask about this paper
Your agent reads all of it.
Lune indexed this paper to the last equation, along with the top-tier papers that cite it. Ask a question and the answer quotes them.
Your agent calls
Luneget_paper_fulltext
Free to start. No credit card required.
Terminal
Install the CLIlune papers fulltext 768b8aea-cbd9-40f9-b115-509e409d8f65Cited by top-tier papers3
- Large Language Models Meet Knowledge Graphs for Question Answering: Synthesis and OpportunitiesChuangtao Ma, Yongrui Chen, Tianxing Wu, Arijit Khan et al.EMNLP 2025 ยท 6 citations
- Reasoning in Flux: Enhancing Large Language Models Reasoning through Uncertainty-aware Adaptive GuidanceZhangyue Yin, Qiushi Sun, Qipeng Guo, Zhiyuan Zeng et al.ACL 2024
- HiAgent: Hierarchical Working Memory Management for Solving Long-Horizon Agent Tasks with Large Language ModelMengkang Hu, Tianxing Chen, Qiguang Chen, Yao Mu et al.ACL 2025
Builds on10
- Chain-of-Thought Prompting Elicits Reasoning in Large Language ModelsJason Wei, Xuezhi Wang, Dale Schuurmans, Maarten Bosma et al.NeurIPS 2022 ยท 22,562 citations
- Learn to Explain: Multimodal Reasoning via Thought Chains for Science Question AnsweringPan Lu, Swaroop Mishra, Tanglin Xia, Liang Qiu et al.NeurIPS 2022 ยท 2,727 citations
- BART: Denoising Sequence-to-Sequence Pre-training for Natural Language Generation, Translation, and ComprehensionMike Lewis, Yinhan Liu, Naman Goyal, Marjan Ghazvininejad et al.ACL 2020 ยท 1,224 citations
- SPARQA: Skeleton-Based Semantic Parsing for Complex Questions over Knowledge BasesYawei Sun, Lingling Zhang, Gong Cheng, Yuzhong QuAAAI 2020 ยท 143 citations
- TransferNet: An Effective and Transparent Framework for Multi-hop Question Answering over Relation GraphJiaxin Shi, Shulin Cao, Lei Hou, Juanzi Li et al.EMNLP 2021 ยท 97 citations
Related papers
- Question Decomposition Tree for Answering Complex Questions over Knowledge BasesXiang Huang, Sitao Cheng, Yiheng Shu, Yuheng Bao et al.AAAI 2023 ยท 33 citations
- Exploring Hybrid Question Answering via Program-based PromptingQi Shi, Han Cui, Haofeng Wang, Qingfu Zhu et al.ACL 2024 ยท 3 citations
- AtomR: Atomic Operator-Empowered Large Language Models for Heterogeneous Knowledge ReasoningAmy Xin, Jinxin Liu, Zijun Yao, Zhicheng Lee et al.KDD 2025 ยท 1 citation
- Beyond Chains: Bridging Large Language Models and Knowledge Bases in Complex Question AnsweringYihua Zhu, Qianying Liu, Akiko Aizawa, Hidetoshi ShimodairaAAAI 2026 ยท 2 citations
- Explainable Conversational Question Answering over Heterogeneous Sources via Iterative Graph Neural NetworksPhilipp Christmann, Rishiraj Saha Roy, Gerhard WeikumSIGIR 2023 ยท 21 citations
