EMNLP Findings2022
Textual Enhanced Contrastive Learning for Solving Math Word Problems
Yibin Shen, Qianying Liu, Zhuoyuan Mao, Fei Cheng, Sadao Kurohashi
Abstract
Solving math word problems is the task that analyses the relation of quantities and requires an accurate understanding of contextual natural language information. Recent studies show that current models rely on shallow heuristics to predict solutions and could be easily misled by small textual perturbations. To address this problem, we propose a Textual Enhanced Contrastive Learning framework, which enforces the models to distinguish semantically similar examples while holding different mathematical logic. We adopt a self-supervised manner strategy to enrich examples with subtle textual variance by textual reordering or problem re-construction. We then retrieve the hardest to differentiate samples from both equation and textual perspectives and guide the model to learn their representations. Experimental results show that our method achieves state-of-the-art on both widely used benchmark datasets and also exquisitely designed challenge datasets in English and Chinese. 1
Ask Lune
Know this paper in minutes, not an afternoon.
Lune can read every page of it and the top-tier papers that cite it, and gives you its claims, its evidence and its limits, each one cited to the paper it comes from. No skimming, no AI slop.
Lineage
- Bootstrap Your Own Latent - A New Approach to Self-Supervised Learning cites A Simple Framework for Contrastive Learning of Visual Representations
- Supervised Contrastive Learning cites A Simple Framework for Contrastive Learning of Visual Representations
- SimCSE: Simple Contrastive Learning of Sentence Embeddings cites A Simple Framework for Contrastive Learning of Visual Representations
Builds on10
- A Simple Framework for Contrastive Learning of Visual RepresentationsTing Chen, Simon Kornblith, Mohammad Norouzi, Geoffrey E. HintonICML 2020 · 24,064 citations
- Bootstrap Your Own Latent - A New Approach to Self-Supervised LearningJean-Bastien Grill, Florian Strub, Florent Altché, Corentin Tallec et al.NeurIPS 2020 · 9,171 citations
- Supervised Contrastive LearningPrannay Khosla, Piotr Teterwak, Chen Wang, Aaron Sarna et al.NeurIPS 2020 · 7,049 citations
- SimCSE: Simple Contrastive Learning of Sentence EmbeddingsTianyu Gao, Xingcheng Yao, Danqi ChenEMNLP 2021 · 2,496 citations
- Graph-to-Tree Learning for Solving Math Word ProblemsJipeng Zhang, Lei Wang, Roy Ka-Wei Lee, Yi Bin et al.ACL 2020 · 129 citations
Related papers
- Seeking Patterns, Not just Memorizing Procedures: Contrastive Learning for Solving Math Word ProblemsZhongli Li, Wenxuan Zhang, Chao Yan, Qingyu Zhou et al.ACL Findings 2022 · 55 citations
- Multi-View Reasoning: Consistent Contrastive Learning for Math Word ProblemWenqi Zhang, Yongliang Shen, Yanna Ma, Xiaoxia Cheng et al.EMNLP Findings 2022 · 17 citations
- Relational Contrastive Learning for Scene Text RecognitionJinglei Zhang, Tiancheng Lin, Yi Xu, Kai Chen et al.ACM MM 2023 · 14 citations
- Contrastive Learning for Knowledge TracingWonsung Lee, Jaeyoon Chun, Youngmin Lee, Kyoungsoo Park et al.WWW 2022 · 111 citations
- Learning from Context or Names? An Empirical Study on Neural Relation ExtractionHao Peng, Tianyu Gao, Xu Han, Yankai Lin et al.EMNLP 2020 · 185 citations
