Mitigating Non-Representative Prototypes and Representation Bias in Few-Shot Continual Relation Extraction
Thanh Duc Pham, Nam Le Hai, Linh Ngo Van, Nguyen Thi Ngoc Diep, Sang Dinh, Thien Huu Nguyen
Abstract
To address the phenomenon of similar classes, existing methods in few-shot continual relation extraction (FCRE) face two main challenges: non-representative prototypes and representation bias, especially when the number of available samples is limited. In our work, we propose Minion to address these challenges. Firstly, we leverage the General Orthogonal Frame (GOF) structure, based on the concept of Neural Collapse, to create robust class pro-totypes with clear separation, even between analogous classes. Secondly, we utilize label description representations as global class representatives within the fast-slow contrastive learning paradigm. These representations consistently encapsulate the essential attributes of each relation, acting as global information that helps mitigate overfitting and reduces representation bias caused by the limited local few-shot examples within a class. Extensive experiments on well-known FCRE benchmarks show that our method outperforms state-of-the-art approaches, demonstrating its effectiveness for advancing RE system.
Ask about this paper
Your agent reads all of it.
Lune indexed this paper to the last equation, along with the top-tier papers that cite it. Ask a question and the answer quotes them.
Your agent calls
Luneget_paper_fulltext
Free to start. No credit card required.
Terminal
Install the CLIlune papers fulltext c63494ca-1f24-4627-b554-a14beea806b9Cited by top-tier papers3
- -Divergence Self-Play for Tabular Anomaly Detection via Large Language ModelsHoang Vuong Tran, Linh Van, Dang Nguyen, Thin Nguyen et al.ICML 2026
- LGSA: Label Geometry Structuring and Aligning for Hierarchical Text ClassificationShuai Zhang, Weibo Xu, Jiahao Nie, Kecheng HuangACL 2026
- TALAS: Teacher-Anchored Layer Alignment with Adaptive Sharpness-Aware Minimization for Embedding DistillationQuoc Phong Dao, Hoang Son Nguyen, Pham Khanh Chi, Linh Ngo Van et al.ACL 2026
Builds on17
- Supervised Contrastive LearningPrannay Khosla, Piotr Teterwak, Chen Wang, Aaron Sarna et al.NeurIPS 2020 · 7,049 citations
- Two are Better than One: Joint Entity and Relation Extraction with Table-Sequence EncodersJue Wang, Wei LuEMNLP 2020 · 209 citations
- Inducing Neural Collapse in Imbalanced Learning: Do We Really Need a Learnable Classifier at the End of Deep Neural Network?Yibo Yang, Shixiang Chen, Xiangtai Li, Liang Xie et al.NeurIPS 2022 · 144 citations
- Exploring Task Difficulty for Few-Shot Relation ExtractionJiale Han, Bo Cheng, Wei LuEMNLP 2021 · 74 citations
- Continual Few-shot Relation Learning via Embedding Space Regularization and Data AugmentationChengwei Qin, Shafiq R. JotyACL 2022 · 49 citations
Related papers
- Consistent Prototype Learning for Few-Shot Continual Relation ExtractionXiudi Chen, Hui Wu, Xiaodong ShiACL 2023 · 17 citations
- Few-Shot, No Problem: Descriptive Continual Relation ExtractionNguyen Xuan Thanh, Anh Duc Le, Quyen Tran, Thanh-Thien Le et al.AAAI 2025 · 6 citations
- ContrastNet: A Contrastive Learning Framework for Few-Shot Text ClassificationJunfan Chen, Richong Zhang, Yongyi Mao, Jie XuAAAI 2022 · 100 citations
- Synergistic Anchored Contrastive Pre-training for Few-Shot Relation ExtractionDa Luo, Yanglei Gan, Rui Hou, Run Lin et al.AAAI 2024 · 12 citations
- Improving Continual Relation Extraction by Distinguishing Analogous SemanticsWenzheng Zhao, Yuanning Cui, Wei HuACL 2023 · 19 citations
