How to Ask Better Questions? A Large-Scale Multi-Domain Dataset for Rewriting Ill-Formed Questions
Zewei Chu, Mingda Chen, Jing Chen, Miaosen Wang, Kevin Gimpel, Manaal Faruqui, Xiance Si
Abstract
We present a large-scale dataset for the task of rewriting an ill-formed natural language question to a well-formed one. Our multi-domain question rewriting (MQR) dataset is constructed from human contributed Stack Exchange question edit histories. The dataset contains 427,719 question pairs which come from 303 domains. We provide human annotations for a subset of the dataset as a quality estimate. When moving from ill-formed to well-formed questions, the question quality improves by an average of 45 points across three aspects. We train sequence-to-sequence neural models on the constructed dataset and obtain an improvement of 13.2% in BLEU-4 over baseline methods built from other data resources. We release the MQR dataset to encourage research on the problem of question rewriting. 1 * Work performed during internship at Google. † Contributed equally.
Ask about this paper
Your agent reads all of it.
Lune indexed this paper to the last equation, along with the top-tier papers that cite it. Ask a question and the answer quotes them.
Cited by top-tier papers4
- ChatQA: Surpassing GPT-4 on Conversational QA and RAGZihan Liu, Wei Ping, Rajarshi Roy, Peng Xu et al.NeurIPS 2024 · 121 citations
- Putting People in LLMs' Shoes: Generating Better Answers via Question RewriterJunhao Chen, Bowen Wang, Zhouqiang Jiang, Yuta NakashimaAAAI 2025 · 5 citations
- Decoding a Neural Retriever's Latent Space for Query SuggestionLeonard Adolphs, Michelle Chen Huebscher, Christian Buck, Sertan Girgin et al.EMNLP 2022 · 4 citations
- Will this Question be Answered? Question Filtering via Answer Model Distillation for Efficient Question AnsweringSiddhant Garg, Alessandro MoschittiEMNLP 2021
Related papers
- CycleKQR: Unsupervised Bidirectional Keyword-Question RewritingAndrea Iovine, Anjie Fang, Besnik Fetahu, Jie Zhao et al.EMNLP 2022 · 3 citations
- CONQRR: Conversational Query Rewriting for Retrieval with Reinforcement LearningZeqiu Wu, Yi Luan, Hannah Rashkin, David Reitter et al.EMNLP 2022 · 37 citations
- DoQA - Accessing Domain-Specific FAQs via Conversational QAJon Ander Campos, Arantxa Otegi, Aitor Soroa, Jan Deriu et al.ACL 2020 · 2 citations
- Building and Evaluating Open-Domain Dialogue Corpora with Clarifying QuestionsMohammad Aliannejadi, Julia Kiseleva, Aleksandr Chuklin, Jeff Dalton et al.EMNLP 2021 · 61 citations
- McQueen: a Benchmark for Multimodal Conversational Query RewriteYifei Yuan, Chen Shi, Runze Wang, Liyi Chen et al.EMNLP 2022 · 6 citations
