EMNLP Findings2020
Dialogue Generation on Infrequent Sentence Functions via Structured Meta-Learning
Yifan Gao, Piji Li, Wei Bi, Xiaojiang Liu, Michael R. Lyu, Irwin King
Abstract
Sentence function is an important linguistic feature indicating the communicative purpose in uttering a sentence. Incorporating sentence functions into conversations has shown improvements in the quality of generated responses. However, the number of utterances for different types of fine-grained sentence functions is extremely imbalanced. Besides a small number of high-resource sentence functions, a large portion of sentence functions is infrequent. Consequently, dialogue generation conditioned on these infrequent sentence functions suffers from data deficiency. In this paper, we investigate a structured meta-learning (SML) approach for dialogue generation on infrequent sentence functions. We treat dialogue generation conditioned on different sentence functions as separate tasks, and apply modelagnostic meta-learning to high-resource sentence functions data. Furthermore, SML enhances meta-learning effectiveness by promoting knowledge customization among different sentence functions but simultaneously preserving knowledge generalization for similar sentence functions. Experimental results demonstrate that SML not only improves the informativeness and relevance of generated responses, but also can generate responses consistent with the target sentence functions.
Ask Lune
Know this paper in minutes, not an afternoon.
Lune can read every page of it and the top-tier papers that cite it, and gives you its claims, its evidence and its limits, each one cited to the paper it comes from. No skimming, no AI slop.
Related papers
- Meta-Reinforced Multi-Domain State Generator for Dialogue SystemsYi Huang, Junlan Feng, Min Hu, Xiaoting Wu et al.ACL 2020 · 30 citations
- Learning to Customize Model Structures for Few-shot Dialogue Generation TasksYiping Song, Zequn Liu, Wei Bi, Rui Yan et al.ACL 2020 · 33 citations
- Exploring Auxiliary Reasoning Tasks for Task-oriented Dialog Systems with Meta Cooperative LearningBowen Qin, Min Yang, Lidong Bing, Qingshan Jiang et al.AAAI 2021 · 9 citations
- Towards Low-Resource Semi-Supervised Dialogue Generation with Meta-LearningYi Huang, Junlan Feng, Shuo Ma, Xiaoyu Du et al.EMNLP Findings 2020 · 2 citations
- Syntactic and Semantic Uniformity for Semantic Parsing and Task-Oriented Dialogue SystemsBowen Chen, Yusuke MiyaoEMNLP Findings 2022 · 1 citation
