Lune

EMNLP Findings2022

Topic-Aware Response Generation in Task-Oriented Dialogue with Unstructured Knowledge Access

Yue Feng, Gerasimos Lampouras, Ignacio Iacobacci

Abstract

To alleviate the problem of structured databases' limited coverage, recent taskoriented dialogue systems incorporate external unstructured knowledge to guide the generation of system responses. However, these usually use word or sentence level similarities to detect the relevant knowledge context, which only partially capture the topical level relevance. In this paper, we examine how to better integrate topical information in knowledge grounded task-oriented dialogue and propose "Topic-Aware Response Generation" (TARG), an end-to-end response generation model. TARG incorporates multiple topic-aware attention mechanisms to derive the importance weighting scheme over dialogue utterances and external knowledge sources towards a better understanding of the dialogue history. Experimental results indicate that TARG achieves state-of-the-art performance in knowledge selection and response generation, outperforming previous state-of-the-art by 3.2, 3.6, and 4.2 points in EM, F1 and BLEU-4 respectively on Doc2Dial, and performing comparably with previous work on DSTC9; both being knowledge-grounded task-oriented dialogue datasets.

Ask Lune

Know this paper in minutes, not an afternoon.

Lune can read every page of it and the top-tier papers that cite it, and gives you its claims, its evidence and its limits, each one cited to the paper it comes from. No skimming, no AI slop.

Questions to start from

Lune can draw on

the full paper · related work

Get the answer

Free to start. No credit card required.

Lineage

  • Topic-Aware Multi-turn Dialogue Modeling cites ALBERT: A Lite BERT for Self-supervised Learning of Language Representations
  • Topic-Aware Multi-turn Dialogue Modeling cites ELECTRA: Pre-training Text Encoders as Discriminators Rather Than Generators
Builds onCited byLeft to right by year; the more cited, the higher.

Builds on13

  1. ALBERT: A Lite BERT for Self-supervised Learning of Language RepresentationsZhenzhong Lan, Mingda Chen, Sebastian Goodman, Kevin Gimpel et al.ICLR 2020 · 7,418 citations
  2. Towards Scalable Multi-Domain Conversational Agents: The Schema-Guided Dialogue DatasetAbhinav Rastogi, Xiaoxue Zang, Srinivas Sunkara, Raghav Gupta et al.AAAI 2020 · 707 citations
  3. ELECTRA: Pre-training Text Encoders as Discriminators Rather Than GeneratorsKevin Clark, Minh-Thang Luong, Quoc V. Le, Christopher D. ManningICLR 2020 · 541 citations
  4. Knowledge-Grounded Dialogue Generation with Pre-trained Language ModelsXueliang Zhao, Wei Wu, Can Xu, Chongyang Tao et al.EMNLP 2020 · 153 citations
  5. Topic-Aware Multi-turn Dialogue ModelingYi Xu, Hai Zhao, Zhuosheng ZhangAAAI 2021 · 93 citations

Related papers

  1. From Retrieval to Generation: A Simple and Unified Generative Model for End-to-End Task-Oriented DialogueZeyuan Ding, Zhihao Yang, Ling Luo, Yuanyuan Sun et al.AAAI 2024 · 6 citations
  2. GraphDialog: Integrating Graph Knowledge into End-to-End Task-Oriented Dialogue SystemsShiquan Yang, Rui Zhang, Sarah M. ErfaniEMNLP 2020 · 46 citations
  3. GraphMemDialog: Optimizing End-to-End Task-Oriented Dialog Systems Using Graph Memory NetworksJie Wu, Ian G. Harris, Hongzhi ZhaoAAAI 2022 · 20 citations
  4. Improving Knowledge-Aware Dialogue Generation via Knowledge Base Question AnsweringJian Wang, Junhao Liu, Wei Bi, Xiaojiang Liu et al.AAAI 2020 · 52 citations
  5. Multi-Grained Knowledge Retrieval for End-to-End Task-Oriented DialogFanqi Wan, Weizhou Shen, Ke Yang, Xiaojun Quan et al.ACL 2023 · 14 citations
Dusk over the sea between two cliffs drawn in fine vertical lines