ACL Findings2023
Cross Encoding as Augmentation: Towards Effective Educational Text Classification
Hyun Seung Lee, Seungtaek Choi, Yunsung Lee, Hyeongdon Moon, Shinhyeok Oh, Myeongho Jeong, Hyojun Go, Christian Wallraven
摘要
Text classification in education, usually called auto-tagging, is the automated process of assigning relevant tags to educational content, such as questions and textbooks. However, auto-tagging suffers from a data scarcity problem, which stems from two major challenges: 1) it possesses a large tag space and 2) it is multi-label. Though a retrieval approach is reportedly good at low-resource scenarios, there have been fewer efforts to directly address the data scarcity problem. To mitigate these issues, here we propose a novel retrieval approach CEAA that provides effective learning in educational text classification. Our main contributions are as follows: 1) we leverage transfer learning from question-answering datasets, and 2) we propose a simple but effective data augmentation method introducing cross-encoder style texts to a bi-encoder architecture for more efficient inference. An extensive set of experiments shows that our proposed method is effective in multi-label scenarios and low-resource tags compared to state-of-the-art models.
问 Lune
几分钟读透这篇 Paper,不用再花一下午。
Lune 能读完全文,也能读引用它的顶会 Paper,讲清它的结论、证据和局限,每一点都注明出自哪篇 Paper。不用硬啃,也不靠猜。
已有 1 篇顶会 Paper 引用了它。别等审稿人问起,先弄清它们发现了什么。
脉络
引用它的顶会 Paper1
它引用的 Paper4
- Language Models are Few-Shot LearnersTom B. Brown, Benjamin Mann, Nick Ryder, Melanie Subbiah 等NeurIPS 2020 · 64,255 次引用
- Poly-encoders: Architectures and Pre-training Strategies for Fast and Accurate Multi-sentence ScoringSamuel Humeau, Kurt Shuster, Marie-Anne Lachaux, Jason WestonICLR 2020 · 316 次引用
- Dense Passage Retrieval for Open-Domain Question AnsweringVladimir Karpukhin, Barlas Oguz, Sewon Min, Patrick Lewis 等EMNLP 2020 · 142 次引用
- An Empirical Study on Large-Scale Multi-Label Text Classification Including Few and Zero-Shot LabelsIlias Chalkidis, Manos Fergadiotis, Sotiris Kotitsas, Prodromos Malakasiotis 等EMNLP 2020 · 2 次引用
相关 Paper
- Text AutoAugment: Learning Compositional Augmentation Policy for Text ClassificationShuhuai Ren, Jinchao Zhang, Lei Li, Xu Sun 等EMNLP 2021 · 22 次引用
- Text Augmentation Using Dataset Reconstruction for Low-Resource ClassificationAdir Rahamim, Guy Uziel, Esther Goldbraich, Ateret Anaby-TavorACL Findings 2023 · 8 次引用
- Unsupervised Energy-based Adversarial Domain Adaptation for Cross-domain Text ClassificationHan Zou, Jianfei Yang, Xiaojian WuACL Findings 2021 · 30 次引用
- Style Transfer as Data Augmentation: A Case Study on Named Entity RecognitionShuguang Chen, Leonardo Neves, Thamar SolorioEMNLP 2022 · 9 次引用
- Don't Miss the Labels: Label-semantic Augmented Meta-Learner for Few-Shot Text ClassificationQiaoyang Luo, Lingqiao Liu, Yuhao Lin, Wei ZhangACL Findings 2021 · 52 次引用
