Modeling What-to-ask and How-to-ask for Answer-unaware Conversational Question Generation
Xuan Long Do, Bowei Zou, Shafiq R. Joty, Anh Tran Tai, Liangming Pan, Nancy F. Chen, Ai Ti Aw
Abstract
Conversational Question Generation (CQG) is a critical task for machines to assist humans in fulfilling their information needs through conversations. The task is generally cast into two different settings: answer-aware and answerunaware. While the former facilitates the models by exposing the expected answer, the latter is more realistic and receiving growing attentions recently. What-to-ask and how-to-ask are the two main challenges in the answer-unaware setting. To address the first challenge, existing methods mainly select sequential sentences in context as the rationales. We argue that the conversation generated using such naive heuristics may not be natural enough as in reality, the interlocutors often talk about the relevant contents that are not necessarily sequential in context. Additionally, previous methods decide the type of question (boolean/span-based) to be generated implicitly. Modeling the question type explicitly is crucial in this (answerunaware) setting, as the answer which hints the models to generate a boolean or span-based question, is unavailable. To this end, we present SG-CQG, a two-stage CQG framework. For the what-to-ask stage, a sentence is selected as the rationale from a semantic graph that we construct, and extract the answer span from it. For the how-to-ask stage, a classifier determines the target answer type of the question via two explicit control signals before generating and filtering. In addition, we propose Conv-Distinct, a novel evaluation metric for CQG, to evaluate the diversity of the generated conversation from a context. Compared with the existing answerunaware CQG models, the proposed SG-CQG achieves state-of-the-art performance.
Ask about this paper
Your agent reads all of it.
Lune indexed this paper to the last equation, along with the top-tier papers that cite it. Ask a question and the answer quotes them.
Your agent calls
Luneget_paper_fulltext
Free to start. No credit card required.
Terminal
Install the CLIlune papers fulltext 093ef1c8-aba9-4b2a-9390-d08a1ac69c53Cited by top-tier papers4
- MinPrompt: Graph-based Minimal Prompt Data Augmentation for Few-shot Question AnsweringXiusi Chen, Jyun-Yu Jiang, Wei-Cheng Chang, Cho-Jui Hsieh et al.ACL 2024 · 7 citations
- Chain-of-Exemplar: Enhancing Distractor Generation for Multimodal Educational Question GenerationHaohao Luo, Yang Deng, Ying Shen, See-Kiong Ng et al.ACL 2024 · 6 citations
- PCQPR: Proactive Conversational Question Planning with ReflectionShasha Guo, Lizi Liao, Jing Zhang, Cuiping Li et al.EMNLP 2024 · 1 citation
- Incubating Text Classifiers Following User Instruction with Nothing but LLMLetian Peng, Zilong Wang, Jingbo ShangEMNLP 2024
Builds on8
- The Curious Case of Neural Text DegenerationAri Holtzman, Jan Buys, Li Du, Maxwell Forbes et al.ICLR 2020 · 4,112 citations
- BART: Denoising Sequence-to-Sequence Pre-training for Natural Language Generation, Translation, and ComprehensionMike Lewis, Yinhan Liu, Naman Goyal, Marjan Ghazvininejad et al.ACL 2020 · 1,224 citations
- Towards Holistic and Automatic Evaluation of Open-Domain Dialogue GenerationBo Pang, Erik Nijkamp, Wenjuan Han, Linqi Zhou et al.ACL 2020 · 69 citations
- End-to-End Synthetic Data Generation for Domain Adaptation of Question Answering SystemsSiamak Shakeri, Cícero Nogueira dos Santos, Henghui Zhu, Patrick Ng et al.EMNLP 2020 · 60 citations
- Synthetic Question Value Estimation for Domain Adaptation of Question AnsweringXiang Yue, Ziyu Yao, Huan SunACL 2022 · 19 citations
Related papers
- Learning to Ask More: Semi-Autoregressive Sequential Question Generation under Dual-Graph InteractionZi Chai, Xiaojun WanACL 2020 · 26 citations
- Controllable Open-ended Question Generation with A New Question Type OntologyShuyang Cao, Lu WangACL 2021
- Asking Questions the Human Way: Scalable Question-Answer Generation from Text CorpusBang Liu, Haojie Wei, Di Niu, Haolan Chen et al.WWW 2020 · 100 citations
- Asking It All: Generating Contextualized Questions for any Semantic RoleValentina Pyatkin, Paul Roit, Julian Michael, Yoav Goldberg et al.EMNLP 2021 · 23 citations
- GTM: A Generative Triple-wise Model for Conversational Question GenerationLei Shen, Fandong Meng, Jinchao Zhang, Yang Feng et al.ACL 2021
