ACL Findings2021
Multi-Lingual Question Generation with Language Agnostic Language Model
Bingning Wang, Ting Yao, Weipeng Chen, Jingfang Xu, Xiaochuan Wang
Abstract
Question generation is the task of generating coherent and relevant question given context paragraph.Recently, with the development of large-scale question answering datasets such as SQuAD, the English question generation has been rapidly developed.However, for other languages such as Chinese, the available training data is limited, which hinders the development of question generation in the corresponding language.To investigate the multi-lingual question generation, in this paper, we develop a language-agnostic language model, which learns the shared representation from several languages in a single architecture.We propose an adversarial training objective to encourage the model to learn both language-specific and language-independent information.We utilize abundant monolingual text to improve the multi-lingual question generation via pre-training.With the languageagnostic language model, we achieve significant improvement in multi-lingual question generation over five languages. In addition, we propose a large-scale Chinese question generation dataset containing more than 220k human-generated questions to benefit the multi-lingual question generation research.
Ask Lune
Know this paper in minutes, not an afternoon.
Lune can read every page of it and the top-tier papers that cite it, and gives you its claims, its evidence and its limits, each one cited to the paper it comes from. No skimming, no AI slop.
1 top-tier paper has cited it since. Know what they found before your reviewers do.
Lune can draw on
the full paper · the top-tier papers that cite it · related work
Free to start. No credit card required.
Lineage
Cited by top-tier papers1
Builds on4
- Reinforcement Learning Based Graph-to-Sequence Model for Natural Question GenerationYu Chen, Lingfei Wu, Mohammed J. ZakiICLR 2020 · 167 citations
- Cross-Lingual Natural Language Generation via Pre-TrainingZewen Chi, Li Dong, Furu Wei, Wenhui Wang et al.AAAI 2020 · 142 citations
- FQuAD: French Question Answering DatasetMartin d'Hoffschmidt, Wacim Belblidia, Quentin Heinrich, Tom Brendlé et al.EMNLP Findings 2020 · 65 citations
- Syn-QG: Syntactic and Shallow Semantic Rules for Question GenerationKaustubh D. Dhole, Christopher D. ManningACL 2020 · 2 citations
Related papers
- Generative Language Models for Paragraph-Level Question GenerationAsahi Ushio, Fernando Alva-Manchego, José Camacho-ColladosEMNLP 2022 · 30 citations
- One Question Answering Model for Many Languages with Cross-lingual Dense Passage RetrievalAkari Asai, Xinyan Yu, Jungo Kasai, Hanna HajishirziNeurIPS 2021 · 86 citations
- Improving Neural Question Generation using Deep Linguistic RepresentationWei Yuan, Tieke He, Xinyu DaiWWW 2021 · 11 citations
- Diversity Enhanced Narrative Question Generation for StorybooksHokeun Yoon, JinYeong BakEMNLP 2023 · 5 citations
- Neural Question Generation with Answer PivotBingning Wang, Xiaochuan Wang, Ting Tao, Qi Zhang et al.AAAI 2020 · 32 citations
