DC-Instruct: An Effective Framework for Generative Multi-intent Spoken Language Understanding
Bowen Xing, Lizi Liao, Minlie Huang, Ivor W. Tsang
Abstract
In the realm of multi-intent spoken language understanding, recent advancements have leveraged the potential of prompt learning frameworks. However, critical gaps exist in these frameworks: the lack of explicit modeling of dual-task dependencies and the oversight of task-specific semantic differences among utterances. To address these shortcomings, we propose DC-Instruct, a novel generative framework based on Dual-task Inter-dependent Instructions (DII) and Supervised Contrastive Instructions (SCI). Specifically, DII guides large language models (LLMs) to generate labels for one task based on the other task's labels, thereby explicitly capturing dual-task interdependencies. Moreover, SCI leverages utterance semantics differences by guiding LLMs to determine whether a pair of utterances share the same or similar labels. This can improve LLMs on extracting and discriminating task-specific semantics, thus enhancing their SLU reasoning abilities. Extensive experiments on public benchmark datasets show that DC-Instruct markedly outperforms current generative models and state-of-the-art methods, demonstrating its effectiveness in enhancing dialogue language understanding and reasoning.
Ask about this paper
Your agent reads all of it.
Lune indexed this paper to the last equation, along with the top-tier papers that cite it. Ask a question and the answer quotes them.
Cited by top-tier papers1
Ask how each one uses itBuilds on7
- LoRA: Low-Rank Adaptation of Large Language ModelsEdward J. Hu, Yelong Shen, Phillip Wallis, Zeyuan Allen-Zhu et al.ICLR 2022 · 18,833 citations
- Is ChatGPT a General-Purpose Natural Language Processing Task Solver?Chengwei Qin, Aston Zhang, Zhuosheng Zhang, Jiaao Chen et al.EMNLP 2023 · 449 citations
- PromptNER: Prompt Locating and Typing for Named Entity RecognitionYongliang Shen, Zeqi Tan, Shuhui Wu, Wenqi Zhang et al.ACL 2023 · 46 citations
- Co-guiding Net: Achieving Mutual Guidances between Multiple Intent Detection and Slot Filling via Heterogeneous Semantics-Label GraphsBowen Xing, Ivor W. TsangEMNLP 2022 · 36 citations
- Enhancing Joint Multiple Intent Detection and Slot Filling with Global Intent-Slot Co-occurrenceMengxiao Song, Bowen Yu, Quangang Li, Yubin Wang et al.EMNLP 2022 · 28 citations
Related papers
- Towards Multi-Intent Spoken Language Understanding via Hierarchical Attention and Optimal TransportXuxin Cheng, Zhihong Zhu, Hongxiang Li, Yaowei Li et al.AAAI 2024 · 19 citations
- CESAR: Automatic Induction of Compositional Instructions for Multi-turn DialogsTaha Aksu, Devamanyu Hazarika, Shikib Mehri, Seokhwan Kim et al.EMNLP 2023
- CINS: Comprehensive Instruction for Few-Shot Learning in Task-Oriented Dialog SystemsFei Mi, Yasheng Wang, Yitong LiAAAI 2022 · 46 citations
- InstructDiff: Domain-Adaptive Data Selection via Contrastive Entropy for Efficient LLM Fine-TuningJunyou Su, He Zhu, Xiao Luo, Liyu Zhang et al.ACL 2026
- InstEmb: Instruction-Following Embeddings through Glimpses of the FutureTianhao Gao, Jun Fang, Xiaohui Zhang, Zhiyuan Liu et al.ICML 2026
