Learning to Reason Deductively: Math Word Problem Solving as Complex Relation Extraction
Zhanming Jie, Jierui Li, Wei Lu
Abstract
Solving math word problems requires deductive reasoning over the quantities in the text. Various recent research efforts mostly relied on sequence-to-sequence or sequence-to-tree models to generate mathematical expressions without explicitly performing relational reasoning between quantities in the given context. While empirically effective, such approaches typically do not provide explanations for the generated expressions. In this work, we view the task as a complex relation extraction problem, proposing a novel approach that presents explainable deductive reasoning steps to iteratively construct target expressions, where each step involves a primitive operation over two quantities defining their relation. Through extensive experiments on four benchmark datasets, we show that the proposed model significantly outperforms existing strong baselines. We further demonstrate that the deductive procedure not only presents more explainable steps but also enables us to make more accurate predictions on questions that require more complex reasoning.
Ask about this paper
Your agent reads all of it.
Lune indexed this paper to the last equation, along with the top-tier papers that cite it. Ask a question and the answer quotes them.
Your agent calls
Luneget_paper_fulltext
Free to start. No credit card required.
Terminal
Install the CLIlune papers fulltext 379565b1-4c19-44e4-a2d0-830b9d2002e6Cited by top-tier papers19
- Chain-of-Thought Prompting Elicits Reasoning in Large Language ModelsJason Wei, Xuezhi Wang, Dale Schuurmans, Maarten Bosma et al.NeurIPS 2022 · 22,562 citations
- Interpreting and Improving Large Language Models in Arithmetic CalculationWei Zhang, Chaoqun Wan, Yonggang Zhang, Yiu-ming Cheung et al.ICML 2024 · 47 citations
- A Survey of Deep Learning for Mathematical ReasoningPan Lu, Liang Qiu, Wenhao Yu, Sean Welleck et al.ACL 2023 · 43 citations
- A Comprehensive Survey of Scientific Large Language Models and Their Applications in Scientific DiscoveryYu Zhang, Xiusi Chen, Bowen Jin, Sheng Wang et al.EMNLP 2024 · 28 citations
- DyRRen: A Dynamic Retriever-Reranker-Generator Model for Numerical Reasoning over Tabular and Textual DataXiao Li, Yin Zhu, Sichen Liu, Jiangzhou Ju et al.AAAI 2023 · 28 citations
Builds on8
- Transformers are RNNs: Fast Autoregressive Transformers with Linear AttentionAngelos Katharopoulos, Apoorv Vyas, Nikolaos Pappas, François FleuretICML 2020 · 2,665 citations
- Neural Module Networks for Reasoning over TextNitish Gupta, Kevin Lin, Dan Roth, Sameer Singh et al.ICLR 2020 · 134 citations
- Graph-to-Tree Learning for Solving Math Word ProblemsJipeng Zhang, Lei Wang, Roy Ka-Wei Lee, Yi Bin et al.ACL 2020 · 129 citations
- A Knowledge-Aware Sequence-to-Tree Network for Math Word Problem SolvingQinzhuo Wu, Qi Zhang, Jinlan Fu, Xuanjing HuangEMNLP 2020 · 71 citations
- HMS: A Hierarchical Solver with Dependency-Enhanced Understanding for Math Word ProblemXin Lin, Zhenya Huang, Hongke Zhao, Enhong Chen et al.AAAI 2021 · 70 citations
Related papers
- A Bottom-Up DAG Structure Extraction Model for Math Word ProblemsYixuan Cao, Feng Hong, Hongwei Li, Ping LuoAAAI 2021 · 57 citations
- Interpretable Math Word Problem Solution Generation via Step-by-step PlanningMengxue Zhang, Zichao Wang, Zhichao Yang, Weiqi Feng et al.ACL 2023 · 5 citations
- An Expression Tree Decoding Strategy for Mathematical Equation GenerationWenqi Zhang, Yongliang Shen, Qingpeng Nong, Zeqi Tan et al.EMNLP 2023 · 3 citations
- EPT-X: An Expression-Pointer Transformer model that generates eXplanations for numbersBugeun Kim, Kyung Seo Ki, Sangkyu Rhim, Gahgene GweonACL 2022
- Math Word Problem Solving with Explicit Numerical ValuesQinzhuo Wu, Qi Zhang, Zhongyu Wei, Xuanjing HuangACL 2021
