EMNLP Findings2023
APP: Adaptive Prototypical Pseudo-Labeling for Few-shot OOD Detection
Pei Wang, Keqing He, Yutao Mou, Xiaoshuai Song, Yanan Wu, Jingang Wang, Yunsen Xian, Xunliang Cai, Weiran Xu
Abstract
Detecting out-of-domain (OOD) intents from user queries is essential for a task-oriented dialogue system. Previous OOD detection studies generally work on the assumption that plenty of labeled IND intents exist. In this paper, we focus on a more practical few-shot OOD setting where there are only a few labeled IND data and massive unlabeled mixed data that may belong to IND or OOD. The new scenario carries two key challenges: learning discriminative representations using limited IND data and leveraging unlabeled mixed data. Therefore, we propose an adaptive prototypical pseudo-labeling (APP) method for few-shot OOD detection, including a prototypical OOD detection framework (ProtoOOD) to facilitate low-resource OOD detection using limited IND data, and an adaptive pseudo-labeling method to produce high-quality pseudo OOD&IND labels. Extensive experiments and analysis demonstrate the effectiveness of our method for few-shot OOD detection. 1
Ask Lune
Ask anything. The answer quotes the paper.
Lune reads all of it and the papers around it, then shows you the passages behind every answer.
Lune answers from
the full paper · 1 top-tier paper that cites it · related work
Free to start. No credit card required.
Cited by top-tier papers1
Builds on3
- Prototypical Contrastive Learning of Unsupervised RepresentationsJunnan Li, Pan Zhou, Caiming Xiong, Steven C. H. HoiICLR 2021 · 484 citations
- Curriculum Labeling: Revisiting Pseudo-Labeling for Semi-Supervised LearningPaola Cascante-Bonilla, Fuwen Tan, Yanjun Qi, Vicente OrdonezAAAI 2021 · 362 citations
- Prototypical Verbalizer for Prompt-based Few-shot TuningGanqu Cui, Shengding Hu, Ning Ding, Longtao Huang et al.ACL 2022
Related papers
- Estimating Soft Labels for Out-of-Domain Intent DetectionHao Lang, Yinhe Zheng, Jian Sun, Fei Huang et al.EMNLP 2022 · 12 citations
- Exploiting Mixed Unlabeled Data for Detecting Samples of Seen and Unseen Out-of-Distribution ClassesYi-Xuan Sun, Wei WangAAAI 2022 · 5 citations
- A Coarse-to-Fine Prototype Learning Approach for Multi-Label Few-Shot Intent DetectionXiaotong Zhang, Xinyi Li, Feng Zhang, Zhiyi Wei et al.EMNLP Findings 2024 · 3 citations
- Out-of-Scope Intent Detection with Self-Supervision and Discriminative TrainingLi-Ming Zhan, Haowen Liang, Bo Liu, Lu Fan et al.ACL 2021
- Pseudo-Label Enhanced Prototypical Contrastive Learning for Uniformed Intent DiscoveryYimin Deng, Yuxia Wu, Guoshuai Zhao, Li Zhu et al.EMNLP Findings 2024 · 2 citations
