ACL Findings2021
Could you give me a hint ? Generating inference graphs for defeasible reasoning
Aman Madaan, Dheeraj Rajagopal, Niket Tandon, Yiming Yang, Eduard H. Hovy
Abstract
Defeasible reasoning is a mode of reasoning where conclusions can be overturned by taking into account new evidence. A commonly used method in cognitive science and logic literature is to handcraft argumentation supporting inference graphs. While humans find inference graphs very useful for reasoning, constructing them at scale is difficult. In this paper, we automatically generate such inference graphs through transfer learning from a related NLP task that shares the kind of reasoning that inference graphs support. Through automated metrics and human evaluation, we find that our method generates meaningful graphs for the defeasible inference task. Human accuracy on this task improves by 20% by consulting the generated graphs. Our findings open up exciting new research avenues for cases where machine reasoning can help human reasoning. 1
Ask Lune
Ask anything. The answer quotes the paper.
Lune reads all of it and the papers around it, then shows you the passages behind every answer.
Lune answers from
the full paper · 7 top-tier papers that cite it · related work
Free to start. No credit card required.
Cited by top-tier papers7
- Can Language Models Solve Graph Problems in Natural Language?Heng Wang, Shangbin Feng, Tianxing He, Zhaoxuan Tan et al.NeurIPS 2023 · 420 citations
- Language Models of Code are Few-Shot Commonsense LearnersAman Madaan, Shuyan Zhou, Uri Alon, Yiming Yang et al.EMNLP 2022 · 103 citations
- Graph-enhanced Large Language Models in Asynchronous Plan ReasoningFangru Lin, Emanuele La Malfa, Valentin Hofmann, Elle Michelle Yang et al.ICML 2024 · 33 citations
- NormBank: A Knowledge Bank of Situational Social NormsCaleb Ziems, Jane Dwivedi-Yu, Yi-Chia Wang, Alon Y. Halevy et al.ACL 2023 · 15 citations
- Think about it! Improving defeasible reasoning by first modeling the question scenarioAman Madaan, Niket Tandon, Dheeraj Rajagopal, Peter Clark et al.EMNLP 2021
Builds on1
Related papers
- Learning to Rationalize for Nonmonotonic Reasoning with Distant SupervisionFaeze Brahman, Vered Shwartz, Rachel Rudinger, Yejin ChoiAAAI 2021 · 46 citations
- ExplaGraphs: An Explanation Graph Generation Task for Structured Commonsense ReasoningSwarnadeep Saha, Prateek Yadav, Lisa Bauer, Mohit BansalEMNLP 2021 · 27 citations
- Knowledge-Enhanced Evidence Retrieval for Counterargument GenerationYohan Jo, Haneul Yoo, JinYeong Bak, Alice Oh et al.EMNLP Findings 2021 · 5 citations
- Improving Unsupervised Commonsense Reasoning Using Knowledge-Enabled Natural Language InferenceCanming Huang, Weinan He, Yongmei LiuEMNLP Findings 2021 · 8 citations
- Reasoning on Knowledge Graphs with Debate DynamicsMarcel Hildebrandt, Jorge Andres Quintero Serna, Yunpu Ma, Martin Ringsquandl et al.AAAI 2020 · 59 citations
