Lune

EMNLP Findings2023

APP: Adaptive Prototypical Pseudo-Labeling for Few-shot OOD Detection

Pei Wang, Keqing He, Yutao Mou, Xiaoshuai Song, Yanan Wu, Jingang Wang, Yunsen Xian, Xunliang Cai, Weiran Xu

Abstract

Detecting out-of-domain (OOD) intents from user queries is essential for a task-oriented dialogue system. Previous OOD detection studies generally work on the assumption that plenty of labeled IND intents exist. In this paper, we focus on a more practical few-shot OOD setting where there are only a few labeled IND data and massive unlabeled mixed data that may belong to IND or OOD. The new scenario carries two key challenges: learning discriminative representations using limited IND data and leveraging unlabeled mixed data. Therefore, we propose an adaptive prototypical pseudo-labeling (APP) method for few-shot OOD detection, including a prototypical OOD detection framework (ProtoOOD) to facilitate low-resource OOD detection using limited IND data, and an adaptive pseudo-labeling method to produce high-quality pseudo OOD&IND labels. Extensive experiments and analysis demonstrate the effectiveness of our method for few-shot OOD detection. 1

Ask Lune

Ask anything. The answer quotes the paper.

Lune reads all of it and the papers around it, then shows you the passages behind every answer.

Questions to start from

Lune answers from

the full paper · 1 top-tier paper that cites it · related work

Get the answer

Free to start. No credit card required.

Cited by top-tier papers1

  1. Learning Geometry-Aware Representations for New Intent DiscoveryKai Tang, Junbo Zhao, Xiao Ding, Runze Wu et al.ACL 2024

Builds on3

  1. Prototypical Contrastive Learning of Unsupervised RepresentationsJunnan Li, Pan Zhou, Caiming Xiong, Steven C. H. HoiICLR 2021 · 484 citations
  2. Curriculum Labeling: Revisiting Pseudo-Labeling for Semi-Supervised LearningPaola Cascante-Bonilla, Fuwen Tan, Yanjun Qi, Vicente OrdonezAAAI 2021 · 362 citations
  3. Prototypical Verbalizer for Prompt-based Few-shot TuningGanqu Cui, Shengding Hu, Ning Ding, Longtao Huang et al.ACL 2022

Related papers

  1. Estimating Soft Labels for Out-of-Domain Intent DetectionHao Lang, Yinhe Zheng, Jian Sun, Fei Huang et al.EMNLP 2022 · 12 citations
  2. Exploiting Mixed Unlabeled Data for Detecting Samples of Seen and Unseen Out-of-Distribution ClassesYi-Xuan Sun, Wei WangAAAI 2022 · 5 citations
  3. A Coarse-to-Fine Prototype Learning Approach for Multi-Label Few-Shot Intent DetectionXiaotong Zhang, Xinyi Li, Feng Zhang, Zhiyi Wei et al.EMNLP Findings 2024 · 3 citations
  4. Out-of-Scope Intent Detection with Self-Supervision and Discriminative TrainingLi-Ming Zhan, Haowen Liang, Bo Liu, Lu Fan et al.ACL 2021
  5. Pseudo-Label Enhanced Prototypical Contrastive Learning for Uniformed Intent DiscoveryYimin Deng, Yuxia Wu, Guoshuai Zhao, Li Zhu et al.EMNLP Findings 2024 · 2 citations
Dusk over the sea between two cliffs drawn in fine vertical lines