Natural Language Deduction with Incomplete Information
Zayne Sprague, Kaj Bostrom, Swarat Chaudhuri, Greg Durrett
Abstract
A growing body of work studies how to answer a question or verify a claim by generating a natural language "proof": a chain of deductive inferences yielding the answer based on a set of premises. However, these methods can only make sound deductions when they follow from evidence that is given. We propose a new system that can handle the underspecified setting where not all premises are stated at the outset; that is, additional assumptions need to be materialized to prove a claim. By using a natural language generation model to abductively infer a premise given another premise and a conclusion, we can impute missing pieces of evidence needed for the conclusion to be true. Our system searches over two fringes in a bidirectional fashion, interleaving deductive (forward-chaining) and abductive (backward-chaining) generation steps. We sample multiple possible outputs for each step to achieve coverage of the search space, at the same time ensuring correctness by filtering low-quality generations with a round-trip validation procedure. Results on a modified version of the EntailmentBank dataset and a new dataset called Everyday Norms: Why Not? show that abductive generation with validation can recover premises across in-and out-ofdomain settings. 1 1 Code and data publicly available at https: //github.com/Zayne-sprague/Natural_Language_ Deduction_with_Incomplete_Information.git An animal requires oxygen to breathe. A human is a kind of animal Astronauts are human.
Ask about this paper
Your agent reads all of it.
Lune indexed this paper to the last equation, along with the top-tier papers that cite it. Ask a question and the answer quotes them.
Cited by top-tier papers6
- MuSR: Testing the Limits of Chain-of-thought with Multistep Soft ReasoningZayne Sprague, Xi Ye, Kaj Bostrom, Swarat Chaudhuri et al.ICLR 2024 · 172 citations
- LAMBADA: Backward Chaining for Automated Reasoning in Natural LanguageMehran Kazemi, Najoung Kim, Deepti Bhatia, Xin Xu et al.ACL 2023 · 27 citations
- VeriCoT: Neuro-symbolic Chain-of-Thought Validation via Logical Consistency ChecksYu Feng, Nathaniel Weir, Kaj Bostrom, Sam Bayless et al.ICLR 2026 · 16 citations
- Vera: A General-Purpose Plausibility Estimation Model for Commonsense StatementsJiacheng Liu, Wenya Wang, Dianzhuo Wang, Noah A. Smith et al.EMNLP 2023 · 9 citations
- SportsMetrics: Blending Text and Numerical Data to Understand Information Fusion in LLMsYebowen Hu, Kaiqiang Song, Sangwoo Cho, Xiaoyang Wang et al.ACL 2024 · 6 citations
Builds on14
- Chain-of-Thought Prompting Elicits Reasoning in Large Language ModelsJason Wei, Xuezhi Wang, Dale Schuurmans, Maarten Bosma et al.NeurIPS 2022 · 22,562 citations
- Deberta: decoding-Enhanced Bert with Disentangled AttentionPengcheng He, Xiaodong Liu, Jianfeng Gao, Weizhu ChenICLR 2021 · 3,729 citations
- Does the Whole Exceed its Parts? The Effect of AI Explanations on Complementary Team PerformanceGagan Bansal, Tongshuang Wu, Joyce Zhou, Raymond Fok et al.CHI 2021 · 713 citations
- Adversarial NLI: A New Benchmark for Natural Language UnderstandingYixin Nie, Adina Williams, Emily Dinan, Mohit Bansal et al.ACL 2020 · 602 citations
- Abductive Commonsense ReasoningChandra Bhagavatula, Ronan Le Bras, Chaitanya Malaviya, Keisuke Sakaguchi et al.ICLR 2020 · 521 citations
Related papers
- Explaining Answers with Entailment TreesBhavana Dalvi, Peter Jansen, Oyvind Tafjord, Zhengnan Xie et al.EMNLP 2021 · 6 citations
- Flexible Generation of Natural Language DeductionsKaj Bostrom, Xinyu Zhao, Swarat Chaudhuri, Greg DurrettEMNLP 2021 · 1 citation
- Generating Natural Language Proofs with Verifier-Guided SearchKaiyu Yang, Jia Deng, Danqi ChenEMNLP 2022 · 22 citations
- Large Language Model for OWL ProofsHui Yang, Jiaoyan Chen, Uli SattlerWWW 2026 · 1 citation
- Multi-modal Action Chain Abductive ReasoningMengze Li, Tianbao Wang, Jiahe Xu, Kairong Han et al.ACL 2023 · 11 citations
