EMNLP Findings2023
Improving Low-resource Question Answering by Augmenting Question Information
Andong Chen, Yuan Sun, Xiaobing Zhao, Rosella P. Galindo Esparza, Kehai Chen, Yang Xiang, Tiejun Zhao, Min Zhang
Abstract
In the era of large models, low-resource question-answering tasks lag, emphasizing the importance of data augmentation. The main challenges include leveraging the large model's internal knowledge for data augmentation, determining which QA data component -the question, passage, or answer -benefits most from augmentation and retaining consistency in the augmented content without inducing excessive noise. To tackle these, we introduce PQQ, an innovative approach for question data augmentation consisting of Prompt Answer, Question Generation, and Question Filter. Our experiments reveal that ChatGPT underperforms on the experimental data, yet our PQQ method excels beyond existing augmentation strategies. Further, its universal applicability is validated through successful tests on high-resource QA tasks like SQUAD1.1 and TriviaQA 1 .
Ask Lune
Know this paper in minutes, not an afternoon.
Lune can read every page of it and the top-tier papers that cite it, and gives you its claims, its evidence and its limits, each one cited to the paper it comes from. No skimming, no AI slop.
Lineage
Builds on5
- Do Not Have Enough Data? Deep Learning to the Rescue!Ateret Anaby-Tavor, Boaz Carmeli, Esther Goldbraich, Amir Kantor et al.AAAI 2020 · 398 citations
- PolicyQA: A Reading Comprehension Dataset for Privacy PoliciesWasi Uddin Ahmad, Jianfeng Chi, Yuan Tian, Kai-Wei ChangEMNLP Findings 2020 · 56 citations
- MLQA: Evaluating Cross-lingual Extractive Question AnsweringPatrick Lewis, Barlas Oguz, Ruty Rinott, Sebastian Riedel et al.ACL 2020 · 52 citations
- Improving Unsupervised Question Answering via Summarization-Informed Question GenerationChenyang Lyu, Lifeng Shang, Yvette Graham, Jennifer Foster et al.EMNLP 2021 · 33 citations
- The TechQA DatasetVittorio Castelli, Rishav Chakravarti, Saswati Dana, Anthony Ferritto et al.ACL 2020 · 23 citations
Related papers
- Training Question Answering Models From Synthetic DataRaul Puri, Ryan Spring, Mohammad Shoeybi, Mostofa Patwary et al.EMNLP 2020 · 15 citations
- BlendFilter: Advancing Retrieval-Augmented Large Language Models via Query Generation Blending and Knowledge FilteringHaoyu Wang, Ruirui Li, Haoming Jiang, Jinjin Tian et al.EMNLP 2024 · 9 citations
- RPDR: A Round-trip Prediction-Based Data Augmentation Framework for Long-Tail Question AnsweringYiming Zhang, Siyue Zhang, Junbo Zhao, Chen ZhaoEMNLP 2025
- CrossQG: Improving Difficulty-Controllable Question Generation through Consistency EnhancementKunze Li, Yu ZhangEMNLP Findings 2025
- A Lightweight Method to Generate Unanswerable Questions in EnglishVagrant Gautam, Miaoran Zhang, Dietrich KlakowEMNLP Findings 2023 · 2 citations
