A Sequential Flow Control Framework for Multi-hop Knowledge Base Question Answering
Minghui Xie, Chuzhan Hao, Peng Zhang
Abstract
One of the key challenges of knowledge base question answering (KBQA) is the multi-hop reasoning. Since in different hops, one attends to different parts of question, it is important to dynamically represent the question semantics for each hop. Existing methods, however, (i) infer the dynamic question representation only through coarse-grained attention mechanisms, which may bring information loss, (ii) and have not effectively modeled the sequential logic, which is crucial for the multi-hop reasoning process in KBQA. To address these issues, we propose a sequential reasoning selfattention mechanism to capture the crucial reasoning information of each single hop in a more fine-grained way. Based on Gated Recurrent Unit (GRU) which is good at modeling sequential process, we propose a simple but effective GRU-inspired Flow Control (GFC) framework to model sequential logic in the whole multi-hop process. Extensive experiments on three popular benchmark datasets have demonstrated the superior effectiveness of our model. In particular, GFC achieves new state-of-the-art Hits@1 of 76.8% on WebQSP and is also effective when KB is incomplete. Our code and data are available at https: //github.com/Xie-Minghui/GFC .
Ask about this paper
Your agent reads all of it.
Lune indexed this paper to the last equation, along with the top-tier papers that cite it. Ask a question and the answer quotes them.
Your agent calls
Luneget_paper_fulltext
Free to start. No credit card required.
Terminal
Install the CLIlune papers fulltext db4c24e8-d9f6-4ce4-9524-2d3624d26d96Builds on4
- Improving Multi-hop Question Answering over Knowledge Graphs using Knowledge Base EmbeddingsApoorv Saxena, Aditay Tripathi, Partha P. TalukdarACL 2020 · 488 citations
- Faithful Embeddings for Knowledge Base QueriesHaitian Sun, Andrew O. Arnold, Tania Bedrax-Weiss, Fernando Pereira et al.NeurIPS 2020 · 104 citations
- TransferNet: An Effective and Transparent Framework for Multi-hop Question Answering over Relation GraphJiaxin Shi, Shulin Cao, Lei Hou, Juanzi Li et al.EMNLP 2021 · 97 citations
- Scalable Neural Methods for Reasoning With a Symbolic Knowledge BaseWilliam W. Cohen, Haitian Sun, R. Alex Hofer, Matthew SieglerICLR 2020 · 71 citations
Related papers
- Learn from Relational Correlations and Periodic Events for Temporal Knowledge Graph ReasoningKe Liang, Lingyuan Meng, Meng Liu, Yue Liu et al.SIGIR 2023 · 117 citations
- Dynamic Key-Value Memory Enhanced Multi-Step Graph Reasoning for Knowledge-Based Visual Question AnsweringMingxiao Li, Marie-Francine MoensAAAI 2022 · 20 citations
- History Semantic Graph Enhanced Conversational KBQA with Temporal Information ModelingHao Sun, Yang Li, Liwei Deng, Bowen Li et al.ACL 2023 · 3 citations
- DREAM: Adaptive Reinforcement Learning based on Attention Mechanism for Temporal Knowledge Graph ReasoningShangfei Zheng, Hongzhi Yin, Tong Chen, Quoc Viet Hung Nguyen et al.SIGIR 2023 · 27 citations
- SQALER: Scaling Question Answering by Decoupling Multi-Hop and Logical ReasoningMattia Atzeni, Jasmina Bogojeska, Andreas LoukasNeurIPS 2021 · 21 citations
