EMNLP Findings2021
Exploiting Reasoning Chains for Multi-hop Science Question Answering
Weiwen Xu, Yang Deng, Huihui Zhang, Deng Cai, Wai Lam
Abstract
We propose a novel Chain Guided Retrieverreader (CGR) framework to model the reasoning chain for multi-hop Science Question Answering. Our framework is capable of performing explainable reasoning without the need of any corpus-specific annotations, such as the ground-truth reasoning chain, or humanannotated entity mentions. Specifically, we first generate reasoning chains from a semantic graph constructed by Abstract Meaning Representation of retrieved evidence facts. A Chain-aware loss, concerning both local and global chain information, is also designed to enable the generated chains to serve as distant supervision signals for training the retriever, where reinforcement learning is also adopted to maximize the utility of the reasoning chains. Our framework allows the retriever to capture step-by-step clues of the entire reasoning process, which is not only shown to be effective on two challenging multi-hop Science QA tasks, namely OpenBookQA and ARC-Challenge, but also favors explainability.
Ask Lune
Ask anything. The answer quotes the paper.
Lune reads all of it and the papers around it, then shows you the passages behind every answer.
Lune answers from
the full paper · 9 top-tier papers that cite it · related work
Free to start. No credit card required.
Cited by top-tier papers9
- Self-Consistency Improves Chain of Thought Reasoning in Language ModelsXuezhi Wang, Jason Wei, Dale Schuurmans, Quoc V. Le et al.ICLR 2023 · 681 citations
- Hierarchy-Aware Multi-Hop Question Answering over Knowledge GraphsJunnan Dong, Qinggang Zhang, Xiao Huang, Keyu Duan et al.WWW 2023 · 46 citations
- Don't Just Say "I don't know"! Self-aligning Large Language Models for Responding to Unknown Questions with ExplanationsYang Deng, Yong Zhao, Moxin Li, See-Kiong Ng et al.EMNLP 2024 · 7 citations
- ConReader: Exploring Implicit Relations in Contracts for Contract Clause ExtractionWeiwen Xu, Yang Deng, Wenqiang Lei, Wenlong Zhao et al.EMNLP 2022 · 7 citations
- Generating Chain-of-Thoughts with a Pairwise-Comparison Approach to Searching for the Most Promising Intermediate ThoughtZhen-Yu Zhang, Siwei Han, Huaxiu Yao, Gang Niu et al.ICML 2024 · 5 citations
Builds on19
- Retrieval-Augmented Generation for Knowledge-Intensive NLP TasksPatrick Lewis, Ethan Perez, Aleksandra Piktus, Fabio Petroni et al.NeurIPS 2020 · 19,162 citations
- UnifiedQA: Crossing Format Boundaries With a Single QA SystemDaniel Khashabi, Sewon Min, Tushar Khot, Ashish Sabharwal et al.EMNLP Findings 2020 · 514 citations
- FreeLB: Enhanced Adversarial Training for Natural Language UnderstandingChen Zhu, Yu Cheng, Zhe Gan, Siqi Sun et al.ICLR 2020 · 502 citations
- Improving Multi-hop Question Answering over Knowledge Graphs using Knowledge Base EmbeddingsApoorv Saxena, Aditay Tripathi, Partha P. TalukdarACL 2020 · 488 citations
- QASC: A Dataset for Question Answering via Sentence CompositionTushar Khot, Peter Clark, Michal Guerquin, Peter Jansen et al.AAAI 2020 · 387 citations
Related papers
- Dynamic Semantic Graph Construction and Reasoning for Explainable Multi-hop Science Question AnsweringWeiwen Xu, Huihui Zhang, Deng Cai, Wai LamACL Findings 2021 · 26 citations
- Explainable Inference Over Grounding-Abstract Chains for Science QuestionsMokanarangan Thayaparan, Marco Valentino, André FreitasACL Findings 2021 · 5 citations
- Open-domain Question Answering via Chain of Reasoning over Heterogeneous KnowledgeKaixin Ma, Hao Cheng, Xiaodong Liu, Eric Nyberg et al.EMNLP Findings 2022 · 16 citations
- MMRAG-RFT: Two-stage Reinforcement Fine-tuning for Explainable Multi-modal Retrieval-augmented GenerationShengwei Zhao, Jingwen Yao, Sitong Wei, Linhai Xu et al.AAAI 2026
- Learning to Retrieve Reasoning Paths over Wikipedia Graph for Question AnsweringAkari Asai, Kazuma Hashimoto, Hannaneh Hajishirzi, Richard Socher et al.ICLR 2020 · 322 citations
