Lune

ACL Findings2024

SELP: A Semantically-Driven Approach for Separated and Accurate Class Prototypes in Few-Shot Text Classification

Wenxin Liang, Tingyu Zhang, Han Liu, Feng Zhang

摘要

The meta-learning paradigm has demonstrated significant effectiveness in few-shot text classification. Currently, numerous efforts are grounded in metric-based learning, utilizing textual feature vectors for classification, with a common emphasis on enlarging inter-class distances to achieve improved classification effectiveness. However, many methods predominantly focus on enhancing the separation of prototypes without taking the semantic relationships between prototypes and class clusters into consideration. This oversight results in incomplete and inaccurate encoding of prototypes within the semantic space, affecting the generality of the learned metric space. In this paper, we propose the utilization of Semantically Enhanced Labels for calibrating class Prototypes (SELP), thereby obtaining prototypes that are more separated and semantically accurate. Additionally, we have devised a center loss to enhance intra-class compactness, coupled with the introduction of a simulated label distribution method to address the overfitting problem. Extensive experiments on eight few-shot text classification datasets show that the proposed method outperforms baselines significantly. Our code is available at https: //github.com/tttyyyzzz-zty/SELP.git.

问 Lune

尽管问,回答会引用原文。

Lune 会读完全文和相关的 Paper,每个回答都附上所依据的原文段落。

可以从这些问题问起

Lune 的依据

全文 · 相关的 Paper

获取答案

免费开始,无需绑卡

它引用的 Paper16

  1. MPNet: Masked and Permuted Pre-training for Language UnderstandingKaitao Song, Xu Tan, Tao Qin, Jianfeng Lu 等NeurIPS 2020 · 1,957 次引用
  2. Learning to Prompt for Continual LearningZifeng Wang, Zizhao Zhang, Chen-Yu Lee, Han Zhang 等CVPR 2022 · 635 次引用
  3. Partial Is Better Than All: Revisiting Fine-tuning Strategy for Few-shot LearningZhiqiang Shen, Zechun Liu, Jie Qin, Marios Savvides 等AAAI 2021 · 203 次引用
  4. Few-shot Text Classification with Distributional SignaturesYujia Bao, Menghua Wu, Shiyu Chang, Regina BarzilayICLR 2020 · 183 次引用
  5. ContrastNet: A Contrastive Learning Framework for Few-Shot Text ClassificationJunfan Chen, Richong Zhang, Yongyi Mao, Jie XuAAAI 2022 · 100 次引用

相关 Paper

  1. Don't Miss the Labels: Label-semantic Augmented Meta-Learner for Few-Shot Text ClassificationQiaoyang Luo, Lingqiao Liu, Yuhao Lin, Wei ZhangACL Findings 2021 · 52 次引用
  2. Improve Meta-learning for Few-Shot Text Classification with All You Can Acquire from the TasksXinyue Liu, Yunlong Gao, Linlin Zong, Bo XuEMNLP Findings 2024 · 6 次引用
  3. Boosting Few-Shot Learning With Adaptive Margin LossAoxue Li, Weiran Huang, Xu Lan, Jiashi Feng 等CVPR 2020
  4. Meta-Learning Adversarial Domain Adaptation Network for Few-Shot Text ClassificationChengcheng Han, Zeqiu Fan, Dongxiang Zhang, Minghui Qiu 等ACL Findings 2021 · 63 次引用
  5. Prompt-Based Meta-Learning For Few-shot Text ClassificationHaoxing Zhang, Xiaofeng Zhang, Haibo Huang, Lei YuEMNLP 2022 · 34 次引用
黄昏的海面,两侧是细线勾勒的悬崖