ACL Findings2023
Hypothetical Training for Robust Machine Reading Comprehension of Tabular Context
Moxin Li, Wenjie Wang, Fuli Feng, Hanwang Zhang, Qifan Wang, Tat-Seng Chua
Abstract
Machine Reading Comprehension (MRC) models easily learn spurious correlations from complex contexts such as tabular data.Counterfactual training-using the factual and counterfactual data by augmentation-has become a promising solution.However, it is costly to construct faithful counterfactual examples because it is tricky to maintain the consistency and dependency of the tabular data.In this paper, we take a more efficient fashion to ask hypothetical questions like "in which year would the net profit be larger if the revenue in 2019 were ) 34,298 37,566 Cost () 29,748 31,326 Question Answer Sample Type In which year was the net profit larger?2018 Factual example In which year would the net profit be larger if the revenue in 2019 were 38,298 instead?2019 Hypothetical example Year 2019 2018 Revenue () 4,550 6,240 Net Profit ($) 33,748 31,326 In which year was the net profit larger?2019 Counterfactual example Editing the tabular context is costly due to the dependency across table entries .
Ask Lune
Know this paper in minutes, not an afternoon.
Lune can read every page of it and the top-tier papers that cite it, and gives you its claims, its evidence and its limits, each one cited to the paper it comes from. No skimming, no AI slop.
Lineage
- Counterfactual Generative Networks cites Learning The Difference That Makes A Difference With Counterfactually-Augmented Data
- Evaluating Models' Local Decision Boundaries via Contrast Sets cites Learning The Difference That Makes A Difference With Counterfactually-Augmented Data
Builds on29
- Learning The Difference That Makes A Difference With Counterfactually-Augmented DataDivyansh Kaushik, Eduard H. Hovy, Zachary Chase LiptonICLR 2020 · 625 citations
- Evaluating Models' Local Decision Boundaries via Contrast SetsMatt Gardner, Yoav Artzi, Victoria Basmova, Jonathan Berant et al.EMNLP Findings 2020 · 260 citations
- HybridQA: A Dataset of Multi-Hop Question Answering over Tabular and Textual DataWenhu Chen, Hanwen Zha, Zhiyu Chen, Wenhan Xiong et al.EMNLP Findings 2020 · 205 citations
- MultiHiertt: Numerical Reasoning over Multi Hierarchical Tabular and Textual DataYilun Zhao, Yunxiang Li, Chenying Li, Rui ZhangACL 2022 · 168 citations
- Counterfactual Generative NetworksAxel Sauer, Andreas GeigerICLR 2021 · 145 citations
Related papers
- Realistic Data Augmentation Framework for Enhancing Tabular ReasoningDibyakanti Kumar, Vivek Gupta, Soumya Sharma, Shuo ZhangEMNLP Findings 2022 · 2 citations
- Generation of Training Examples for Tabular Natural Language InferenceJean-Flavien Bussotti, Enzo Veltri, Donatello Santoro, Paolo PapottiSIGMOD 2024 · 7 citations
- A Robust Adversarial Training Approach to Machine Reading ComprehensionKai Liu, Xin Liu, An Yang, Jing Liu et al.AAAI 2020 · 54 citations
- TSQA: Tabular Scenario Based Question AnsweringXiao Li, Yawei Sun, Gong ChengAAAI 2021 · 37 citations
- Measuring and Improving Attentiveness to Partial Inputs with CounterfactualsYanai Elazar, Bhargavi Paranjape, Hao Peng, Sarah Wiegreffe et al.EMNLP Findings 2024
