Lune

ACL Findings2023

Multi-Domain Dialogue State Tracking with Disentangled Domain-Slot Attention

Longfei Yang, Jiyi Li, Sheng Li, Takahiro Shinozaki

Abstract

As the core of task-oriented dialogue systems, dialogue state tracking (DST) is designed to track the dialogue state through the conversation between users and systems. Multi-domain DST has been an important challenge in which the dialogue states across multiple domains need to consider. In recent mainstream approaches, each domain and slot are aggregated and regarded as a single query feeding into attention with the dialogue history to obtain domain-slot specific representations. In this work, we propose disentangled domain-slot attention for multi-domain dialogue state tracking. The proposed approach disentangles the domain-slot specific information extraction in a flexible and context-dependent manner by separating the query about domains and slots in the attention component. Through a series of experiments on MultiWOZ 2.0 and MultiWOZ 2.4 datasets, we demonstrate that our proposed approach outperforms the standard multi-head attention with aggregated domain-slot query.

Ask Lune

Ask anything. The answer quotes the paper.

Lune reads all of it and the papers around it, then shows you the passages behind every answer.

Questions to start from

Lune answers from

the full paper · related work

Get the answer

Free to start. No credit card required.

Builds on8

  1. A Simple Language Model for Task-Oriented DialogueEhsan Hosseini-Asl, Bryan McCann, Chien-Sheng Wu, Semih Yavuz et al.NeurIPS 2020 · 590 citations
  2. Efficient Dialogue State Tracking by Selectively Overwriting MemorySungdong Kim, Sohee Yang, Gyuwan Kim, Sang-Woo LeeACL 2020 · 189 citations
  3. Schema-Guided Multi-Domain Dialogue State Tracking with Graph Attention Neural NetworksLu Chen, Boer Lv, Chi Wang, Su Zhu et al.AAAI 2020 · 143 citations
  4. MinTL: Minimalist Transfer Learning for Task-Oriented Dialogue SystemsZhaojiang Lin, Andrea Madotto, Genta Indra Winata, Pascale FungEMNLP 2020 · 138 citations
  5. Slot Self-Attentive Dialogue State TrackingFanghua Ye, Jarana Manotumruksa, Qiang Zhang, Shenghui Li et al.WWW 2021 · 68 citations

Related papers

  1. MA-DST: Multi-Attention-Based Scalable Dialog State TrackingAdarsh Kumar, Peter Ku, Anuj Kumar Goyal, Angeliki Metallinou et al.AAAI 2020 · 61 citations
  2. GCDST: A Graph-based and Copy-augmented Multi-domain Dialogue State TrackingPeng Wu, Bowei Zou, Ridong Jiang, AiTi AwEMNLP Findings 2020 · 13 citations
  3. Knowledge-Aware Graph-Enhanced GPT-2 for Dialogue State TrackingWeizhe Lin, Bo-Hsiang Tseng, Bill ByrneEMNLP 2021 · 3 citations
  4. Dialogue State Distillation Network with Inter-slot Contrastive Learning for Dialogue State TrackingJing Xu, Dandan Song, Chong Liu, Siu Cheung Hui et al.AAAI 2023 · 8 citations
  5. A Contextual Hierarchical Attention Network with Adaptive Objective for Dialogue State TrackingYong Shan, Zekang Li, Jinchao Zhang, Fandong Meng et al.ACL 2020 · 58 citations
Dusk over the sea between two cliffs drawn in fine vertical lines