Aligner²: Enhancing Joint Multiple Intent Detection and Slot Filling via Adjustive and Forced Cross-Task Alignment
Zhihong Zhu, Xuxin Cheng, Yaowei Li, Hongxiang Li, Yuexian Zou
Abstract
Multi-intent spoken language understanding (SLU) has garnered growing attention due to its ability to handle multiple intent utterances, which closely mirrors practical scenarios. Unlike traditional SLU, each intent in multi-intent SLU corresponds to its designated scope for slots, which occurs in certain fragments within the utterance. As a result, establishing precise scope alignment to mitigate noise impact emerges as a key challenge in multi-intent SLU. More seriously, they lack alignment between the predictions of the two sub-tasks due to task-independent decoding, resulting in a limitation on the overall performance. To address these challenges, we propose a novel framework termed Aligner 2 for multi-intent SLU, which contains an Adjustive Cross-task Aligner (ACA) and a Forced Cross-task Aligner (FCA). ACA utilizes the information conveyed by joint label embeddings to accurately align the scope of intent and corresponding slots, before the interaction of the two subtasks. FCA introduces reinforcement learning, to enforce the alignment of the task-specific hidden states after the interaction, which is explicitly guided by the prediction. Extensive experiments on two public multi-intent SLU datasets demonstrate the superiority of our Aligner 2 over state-of-the-art methods. More encouragingly, the proposed method Aligner 2 can be easily integrated into existing multiintent SLU frameworks, to further boost performance.
Ask about this paper
Your agent reads all of it.
Lune indexed this paper to the last equation, along with the top-tier papers that cite it. Ask a question and the answer quotes them.
Your agent calls
Luneget_paper_fulltext
Free to start. No credit card required.
Terminal
Install the CLIlune papers fulltext ded7a717-061a-4cc9-9872-662d3d95a8f0Cited by top-tier papers1
Ask how each one uses itBuilds on6
- Enhancing Joint Multiple Intent Detection and Slot Filling with Global Intent-Slot Co-occurrenceMengxiao Song, Bowen Yu, Quangang Li, Yubin Wang et al.EMNLP 2022 · 28 citations
- Group is better than individual: Exploiting Label Topologies and Label Relations for Joint Multiple Intent Detection and Slot FillingBowen Xing, Ivor W. TsangEMNLP 2022 · 24 citations
- Towards Multi-Intent Spoken Language Understanding via Hierarchical Attention and Optimal TransportXuxin Cheng, Zhihong Zhu, Hongxiang Li, Yaowei Li et al.AAAI 2024 · 19 citations
- A Scope Sensitive and Result Attentive Model for Multi-Intent Spoken Language UnderstandingLizhi Cheng, Wenmian Yang, Weijia JiaAAAI 2023 · 18 citations
- GL-GIN: Fast and Accurate Non-Autoregressive Model for Joint Multiple Intent Detection and Slot FillingLibo Qin, Fuxuan Wei, Tianbao Xie, Xiao Xu et al.ACL 2021
Related papers
- Uni-MIS: United Multiple Intent Spoken Language Understanding via Multi-View Intent-Slot InteractionShangjian Yin, Peijie Huang, Yuhong XuAAAI 2024 · 10 citations
- Label-aware Multi-level Contrastive Learning for Cross-lingual Spoken Language UnderstandingShining Liang, Linjun Shou, Jian Pei, Ming Gong et al.EMNLP 2022 · 7 citations
- Co-guiding Net: Achieving Mutual Guidances between Multiple Intent Detection and Slot Filling via Heterogeneous Semantics-Label GraphsBowen Xing, Ivor W. TsangEMNLP 2022 · 36 citations
- GL-CLeF: A Global-Local Contrastive Learning Framework for Cross-lingual Spoken Language UnderstandingLibo Qin, Qiguang Chen, Tianbao Xie, Qixin Li et al.ACL 2022 · 36 citations
- DC-Instruct: An Effective Framework for Generative Multi-intent Spoken Language UnderstandingBowen Xing, Lizi Liao, Minlie Huang, Ivor W. TsangEMNLP 2024 · 9 citations
