Lune

ACL Findings2021

Multi-Lingual Question Generation with Language Agnostic Language Model

Bingning Wang, Ting Yao, Weipeng Chen, Jingfang Xu, Xiaochuan Wang

Abstract

Question generation is the task of generating coherent and relevant question given context paragraph.Recently, with the development of large-scale question answering datasets such as SQuAD, the English question generation has been rapidly developed.However, for other languages such as Chinese, the available training data is limited, which hinders the development of question generation in the corresponding language.To investigate the multi-lingual question generation, in this paper, we develop a language-agnostic language model, which learns the shared representation from several languages in a single architecture.We propose an adversarial training objective to encourage the model to learn both language-specific and language-independent information.We utilize abundant monolingual text to improve the multi-lingual question generation via pre-training.With the languageagnostic language model, we achieve significant improvement in multi-lingual question generation over five languages. In addition, we propose a large-scale Chinese question generation dataset containing more than 220k human-generated questions to benefit the multi-lingual question generation research.

Ask Lune

Know this paper in minutes, not an afternoon.

Lune can read every page of it and the top-tier papers that cite it, and gives you its claims, its evidence and its limits, each one cited to the paper it comes from. No skimming, no AI slop.

1 top-tier paper has cited it since. Know what they found before your reviewers do.

Questions to start from

Lune can draw on

the full paper · the top-tier papers that cite it · related work

Get the answer

Free to start. No credit card required.

Lineage

  • Cross-lingual Transfer for Automatic Question Generation by Learning Interrogative Structures in Target Languages cites Cross-Lingual Natural Language Generation via Pre-Training
Builds onCited byLeft to right by year; the more cited, the higher.

Cited by top-tier papers1

  1. Cross-lingual Transfer for Automatic Question Generation by Learning Interrogative Structures in Target LanguagesSeonjeong Hwang, Yunsu Kim, Gary Geunbae LeeEMNLP 2024 · 2 citations

Builds on4

  1. Reinforcement Learning Based Graph-to-Sequence Model for Natural Question GenerationYu Chen, Lingfei Wu, Mohammed J. ZakiICLR 2020 · 167 citations
  2. Cross-Lingual Natural Language Generation via Pre-TrainingZewen Chi, Li Dong, Furu Wei, Wenhui Wang et al.AAAI 2020 · 142 citations
  3. FQuAD: French Question Answering DatasetMartin d'Hoffschmidt, Wacim Belblidia, Quentin Heinrich, Tom Brendlé et al.EMNLP Findings 2020 · 65 citations
  4. Syn-QG: Syntactic and Shallow Semantic Rules for Question GenerationKaustubh D. Dhole, Christopher D. ManningACL 2020 · 2 citations

Related papers

  1. Generative Language Models for Paragraph-Level Question GenerationAsahi Ushio, Fernando Alva-Manchego, José Camacho-ColladosEMNLP 2022 · 30 citations
  2. One Question Answering Model for Many Languages with Cross-lingual Dense Passage RetrievalAkari Asai, Xinyan Yu, Jungo Kasai, Hanna HajishirziNeurIPS 2021 · 86 citations
  3. Improving Neural Question Generation using Deep Linguistic RepresentationWei Yuan, Tieke He, Xinyu DaiWWW 2021 · 11 citations
  4. Diversity Enhanced Narrative Question Generation for StorybooksHokeun Yoon, JinYeong BakEMNLP 2023 · 5 citations
  5. Neural Question Generation with Answer PivotBingning Wang, Xiaochuan Wang, Ting Tao, Qi Zhang et al.AAAI 2020 · 32 citations
Dusk over the sea between two cliffs drawn in fine vertical lines