Pre-training to Match for Unified Low-shot Relation Extraction
Fangchao Liu, Hongyu Lin, Xianpei Han, Boxi Cao, Le Sun
Abstract
Low-shot relation extraction (RE) aims to recognize novel relations with very few or even no samples, which is critical in real scenario application. Few-shot and zero-shot RE are two representative low-shot RE tasks, which seem to be with similar target but require totally different underlying abilities. In this paper, we propose Multi-Choice Matching Networks to unify low-shot relation extraction. To fill in the gap between zero-shot and few-shot RE, we propose the triplet-paraphrase metatraining, which leverages triplet paraphrase to pre-train zero-shot label matching ability and uses meta-learning paradigm to learn few-shot instance summarizing ability. Experimental results on three different low-shot RE tasks show that the proposed method outperforms strong baselines by a large margin, and achieve the best performance on few-shot RE leaderboard 1 .
Ask about this paper
Your agent reads all of it.
Lune indexed this paper to the last equation, along with the top-tier papers that cite it. Ask a question and the answer quotes them.
Your agent calls
Luneget_paper_fulltext
Free to start. No credit card required.
Terminal
Install the CLIlune papers fulltext a97ec572-62b0-4aee-b2a3-1e8e681dcb22Cited by top-tier papers5
- GPT-RE: In-context Learning for Relation Extraction using Large Language ModelsZhen Wan, Fei Cheng, Zhuoyuan Mao, Qianying Liu et al.EMNLP 2023 · 132 citations
- Universal Information Extraction as Unified Semantic MatchingJie Lou, Yaojie Lu, Dai Dai, Wei Jia et al.AAAI 2023 · 96 citations
- Better Few-Shot Relation Extraction with Label Prompt DropoutPeiyuan Zhang, Wei LuEMNLP 2022 · 21 citations
- Multi-Label Zero-Shot Product Attribute-Value ExtractionJiaying Gong, Hoda EldardiryWWW 2024 · 8 citations
- When Phrases Meet Probabilities: Enabling Open Relation Extraction with Cooperating Large Language ModelsJiaxin Wang, Lingling Zhang, Wee Sun Lee, Yujie Zhong et al.ACL 2024
Builds on4
- Language Models are Few-Shot LearnersTom B. Brown, Benjamin Mann, Nick Ryder, Melanie Subbiah et al.NeurIPS 2020 · 64,255 citations
- FLEX: Unifying Evaluation for Few-Shot NLPJonathan Bragg, Arman Cohan, Kyle Lo, Iz BeltagyNeurIPS 2021 · 114 citations
- MapRE: An Effective Semantic Mapping Approach for Low-resource Relation ExtractionManqing Dong, Chunguang Pan, Zhipeng LuoEMNLP 2021 · 35 citations
- Element Intervention for Open Relation ExtractionFangchao Liu, Lingyong Yan, Hongyu Lin, Xianpei Han et al.ACL 2021
Related papers
- Exploring Task Difficulty for Few-Shot Relation ExtractionJiale Han, Bo Cheng, Wei LuEMNLP 2021 · 74 citations
- Few-shot Relation Extraction via Bayesian Meta-learning on Relation GraphsMeng Qu, Tianyu Gao, Louis-Pascal A. C. Xhonneux, Jian TangICML 2020 · 131 citations
- Generative Meta-Learning for Zero-Shot Relation Triplet ExtractionWanli Li, Tieyun Qian, Yi Song, Zeyu Zhang et al.SIGIR 2025 · 4 citations
- HyperNetwork-based Decoupling to Improve Model Generalization for Few-Shot Relation ExtractionLiang Zhang, Chulun Zhou, Fandong Meng, Jinsong Su et al.EMNLP 2023 · 3 citations
- Consistent Prototype Learning for Few-Shot Continual Relation ExtractionXiudi Chen, Hui Wu, Xiaodong ShiACL 2023 · 17 citations
