CQG: A Simple and Effective Controlled Generation Framework for Multi-hop Question Generation
Zichu Fei, Qi Zhang, Tao Gui, Di Liang, Sirui Wang, Wei Wu, Xuanjing Huang
Abstract
Multi-hop question generation focuses on generating complex questions that require reasoning over multiple pieces of information of the input passage. Current models with state-of-the-art performance have been able to generate the correct questions corresponding to the answers. However, most models can not ensure the complexity of generated questions, so they may generate shallow questions that can be answered without multi-hop reasoning. To address this challenge, we propose the CQG, which is a simple and effective controlled framework. CQG employs a simple method to generate the multi-hop questions that contain key entities in multi-hop reasoning chains, which ensure the complexity and quality of the questions. In addition, we introduce a novel controlled Transformer-based decoder to guarantee that key entities appear in the questions. Experiment results show that our model greatly improves performance, which also outperforms the state-of-the-art model about 25% by 5 BLEU points on HotpotQA 1 .
Ask about this paper
Your agent reads all of it.
Lune indexed this paper to the last equation, along with the top-tier papers that cite it. Ask a question and the answer quotes them.
Your agent calls
Luneget_paper_fulltext
Free to start. No credit card required.
Terminal
Install the CLIlune papers fulltext f7f42262-30dd-482d-918d-8eef49ef3adbCited by top-tier papers15
- Question Calibration and Multi-Hop Modeling for Temporal Question AnsweringChao Xue, Di Liang, Pengfei Wang, Jing ZhangAAAI 2024 · 27 citations
- Guideline Learning for In-Context Information ExtractionChaoxu Pang, Yixuan Cao, Qiang Ding, Ping LuoEMNLP 2023 · 12 citations
- QGEval: Benchmarking Multi-dimensional Evaluation for Question GenerationWeiping Fu, Bifan Wei, Jianxiang Hu, Zhongmin Cai et al.EMNLP 2024 · 8 citations
- Why Supervised Fine-Tuning Fails to Learn: A Systematic Study of Incomplete Learning in Large Language ModelsChao Xue, Yao Wang, Mengqiao Liu, Di Liang et al.ACL 2026 · 5 citations
- Not All Parameters Are Created Equal: Smart Isolation Boosts Fine-Tuning PerformanceYao Wang, Di Liang, Minlong PengEMNLP 2025 · 3 citations
Builds on5
- Reinforcement Learning Based Graph-to-Sequence Model for Natural Question GenerationYu Chen, Lingfei Wu, Mohammed J. ZakiICLR 2020 · 167 citations
- Semantic Graphs for Generating Deep QuestionsLiangming Pan, Yuxi Xie, Yansong Feng, Tat-Seng Chua et al.ACL 2020 · 79 citations
- Gradient-guided Unsupervised Lexically Constrained Text GenerationLei ShaEMNLP 2020 · 35 citations
- Generating Multi-hop Reasoning Questions to Improve Machine Reading ComprehensionJianxing Yu, Xiaojun Quan, Qinliang Su, Jian YinWWW 2020 · 25 citations
- Mention Flags (MF): Constraining Transformer-based Text GeneratorsYufei Wang, Ian D. Wood, Stephen Wan, Mark Dras et al.ACL 2021
Related papers
- Modeling Multi-hop Question Answering as Single Sequence PredictionSemih Yavuz, Kazuma Hashimoto, Yingbo Zhou, Nitish Shirish Keskar et al.ACL 2022 · 35 citations
- Low-Resource Generation of Multi-hop Reasoning QuestionsJianxing Yu, Wei Liu, Shuang Qiu, Qinliang Su et al.ACL 2020 · 11 citations
- Mitigating Lost-in-Retrieval Problems in Retrieval Augmented Multi-Hop Question AnsweringRongzhi Zhu, Xiangyu Liu, Zequn Sun, Yiwei Wang et al.ACL 2025 · 14 citations
- Counterfactual Multihop QA: A Cause-Effect Approach for Reducing Disconnected ReasoningWangzhen Guo, Qinkang Gong, Yanghui Rao, Hanjiang LaiACL 2023 · 4 citations
- Enhancing Multi-modal Multi-hop Question Answering via Structured Knowledge and Unified Retrieval-GenerationQian Yang, Qian Chen, Wen Wang, Baotian Hu et al.ACM MM 2023 · 14 citations
