Few-Shot, No Problem: Descriptive Continual Relation Extraction
Nguyen Xuan Thanh, Anh Duc Le, Quyen Tran, Thanh-Thien Le, Linh Ngo Van, Thien Huu Nguyen
Abstract
Few-shot Continual Relation Extraction is a crucial challenge for enabling AI systems to identify and adapt to evolving relationships in dynamic real-world domains. Traditional memory-based approaches often overfit to limited samples, failing to reinforce old knowledge, with the scarcity of data in few-shot scenarios further exacerbating these issues by hindering effective data augmentation in the latent space. In this paper, we propose a novel retrieval-based solution, starting with a large language model to generate descriptions for each relation. From these descriptions, we introduce a bi-encoder retrieval training paradigm to enrich both sample and class representation learning. Leveraging these enhanced representations, we design a retrieval-based prediction method where each sample "retrieves" the best fitting relation via a reciprocal rank fusion score that integrates both relation description vectors and class prototypes. Extensive experiments on multiple datasets demonstrate that our method significantly advances the state-of-the-art by maintaining robust performance across sequential tasks, effectively addressing catastrophic forgetting.
Ask about this paper
Your agent reads all of it.
Lune indexed this paper to the last equation, along with the top-tier papers that cite it. Ask a question and the answer quotes them.
Your agent calls
Luneget_paper_fulltext
Free to start. No credit card required.
Terminal
Install the CLIlune papers fulltext 6d56db02-007c-4baa-abb4-c19e398f1f51Cited by top-tier papers2
- An Optimal Transport-driven Approach for Cultivating Latent Space in Online Incremental LearningQuyen Tran, Hai Nguyen, Minh Quan Dao, Hoang Phan et al.CVPR 2026
- Mitigating Non-Representative Prototypes and Representation Bias in Few-Shot Continual Relation ExtractionThanh Duc Pham, Nam Le Hai, Linh Ngo Van, Nguyen Thi Ngoc Diep et al.ACL 2025
Builds on8
- Supervised Contrastive LearningPrannay Khosla, Piotr Teterwak, Chen Wang, Aaron Sarna et al.NeurIPS 2020 · 7,049 citations
- Continual Few-shot Relation Learning via Embedding Space Regularization and Data AugmentationChengwei Qin, Shafiq R. JotyACL 2022 · 49 citations
- Consistent Prototype Learning for Few-Shot Continual Relation ExtractionXiudi Chen, Hui Wu, Xiaodong ShiACL 2023 · 17 citations
- Continual Relation Extraction via Sequential Multi-Task LearningThanh-Thien Le, Manh Nguyen, Tung Thanh Nguyen, Ngo Van Linh et al.AAAI 2024 · 16 citations
- Adaptive Prompting for Continual Relation Extraction: A Within-Task Variance PerspectiveMinh Le, Tien Ngoc Luu, An Nguyen The, Thanh-Thien Le et al.AAAI 2025 · 12 citations
Related papers
- Preserving Generalization of Language models in Few-shot Continual Relation ExtractionQuyen Tran, Nguyen Xuan Thanh, Nguyen Hoang Anh, Nam Le Hai et al.EMNLP 2024 · 2 citations
- Improving Continual Relation Extraction by Distinguishing Analogous SemanticsWenzheng Zhao, Yuanning Cui, Wei HuACL 2023 · 19 citations
- Refining Sample Embeddings with Relation Prototypes to Enhance Continual Relation ExtractionLi Cui, Deqing Yang, Jiaxin Yu, Chengwei Hu et al.ACL 2021
- Learning Robust Representations for Continual Relation Extraction via Adversarial Class AugmentationPeiyi Wang, Yifan Song, Tianyu Liu, Binghuai Lin et al.EMNLP 2022 · 23 citations
- RECALL: REpresentation-aligned Catastrophic-forgetting ALLeviation via Hierarchical Model MergingBowen Wang, Haiyuan Wan, Liwen Shi, Chen Yang et al.EMNLP 2025
