Lune

ACL Findings2024

SELP: A Semantically-Driven Approach for Separated and Accurate Class Prototypes in Few-Shot Text Classification

Wenxin Liang, Tingyu Zhang, Han Liu, Feng Zhang

Abstract

The meta-learning paradigm has demonstrated significant effectiveness in few-shot text classification. Currently, numerous efforts are grounded in metric-based learning, utilizing textual feature vectors for classification, with a common emphasis on enlarging inter-class distances to achieve improved classification effectiveness. However, many methods predominantly focus on enhancing the separation of prototypes without taking the semantic relationships between prototypes and class clusters into consideration. This oversight results in incomplete and inaccurate encoding of prototypes within the semantic space, affecting the generality of the learned metric space. In this paper, we propose the utilization of Semantically Enhanced Labels for calibrating class Prototypes (SELP), thereby obtaining prototypes that are more separated and semantically accurate. Additionally, we have devised a center loss to enhance intra-class compactness, coupled with the introduction of a simulated label distribution method to address the overfitting problem. Extensive experiments on eight few-shot text classification datasets show that the proposed method outperforms baselines significantly. Our code is available at https: //github.com/tttyyyzzz-zty/SELP.git.

Ask Lune

Ask anything. The answer quotes the paper.

Lune reads all of it and the papers around it, then shows you the passages behind every answer.

Questions to start from

Lune answers from

the full paper · related work

Get the answer

Free to start. No credit card required.

Builds on16

  1. MPNet: Masked and Permuted Pre-training for Language UnderstandingKaitao Song, Xu Tan, Tao Qin, Jianfeng Lu et al.NeurIPS 2020 · 1,957 citations
  2. Learning to Prompt for Continual LearningZifeng Wang, Zizhao Zhang, Chen-Yu Lee, Han Zhang et al.CVPR 2022 · 635 citations
  3. Partial Is Better Than All: Revisiting Fine-tuning Strategy for Few-shot LearningZhiqiang Shen, Zechun Liu, Jie Qin, Marios Savvides et al.AAAI 2021 · 203 citations
  4. Few-shot Text Classification with Distributional SignaturesYujia Bao, Menghua Wu, Shiyu Chang, Regina BarzilayICLR 2020 · 183 citations
  5. ContrastNet: A Contrastive Learning Framework for Few-Shot Text ClassificationJunfan Chen, Richong Zhang, Yongyi Mao, Jie XuAAAI 2022 · 100 citations

Related papers

  1. Don't Miss the Labels: Label-semantic Augmented Meta-Learner for Few-Shot Text ClassificationQiaoyang Luo, Lingqiao Liu, Yuhao Lin, Wei ZhangACL Findings 2021 · 52 citations
  2. Improve Meta-learning for Few-Shot Text Classification with All You Can Acquire from the TasksXinyue Liu, Yunlong Gao, Linlin Zong, Bo XuEMNLP Findings 2024 · 6 citations
  3. Boosting Few-Shot Learning With Adaptive Margin LossAoxue Li, Weiran Huang, Xu Lan, Jiashi Feng et al.CVPR 2020
  4. Meta-Learning Adversarial Domain Adaptation Network for Few-Shot Text ClassificationChengcheng Han, Zeqiu Fan, Dongxiang Zhang, Minghui Qiu et al.ACL Findings 2021 · 63 citations
  5. Prompt-Based Meta-Learning For Few-shot Text ClassificationHaoxing Zhang, Xiaofeng Zhang, Haibo Huang, Lei YuEMNLP 2022 · 34 citations
Dusk over the sea between two cliffs drawn in fine vertical lines