Neural Snowball for Few-Shot Relation Learning
Tianyu Gao, Xu Han, Ruobing Xie, Zhiyuan Liu, Fen Lin, Leyu Lin, Maosong Sun
Abstract
Knowledge graphs typically undergo open-ended growth of new relations. This cannot be well handled by relation extraction that focuses on pre-defined relations with sufficient training data. To address new relations with few-shot instances, we propose a novel bootstrapping approach, Neural Snowball, to learn new relations by transferring semantic knowledge about existing relations. More specifically, we use Relational Siamese Networks (RSN) to learn the metric of relational similarities between instances based on existing relations and their labeled data. Afterwards, given a new relation and its few-shot instances, we use RSN to accumulate reliable instances from unlabeled corpora; these instances are used to train a relation classifier, which can further identify new facts of the new relation. The process is conducted iteratively like a snowball. Experiments show that our model can gather high-quality instances for better few-shot relation learning and achieves significant improvement compared to baselines. Codes and datasets are released on https://github.com/thunlp/Neural-Snowball.
Ask about this paper
Your agent reads all of it.
Lune indexed this paper to the last equation, along with the top-tier papers that cite it. Ask a question and the answer quotes them.
Cited by top-tier papers11
- KnowPrompt: Knowledge-aware Prompt-tuning with Synergistic Optimization for Relation ExtractionXiang Chen, Ningyu Zhang, Xin Xie, Shumin Deng et al.WWW 2022 · 488 citations
- Few-shot Slot Tagging with Collapsed Dependency Transfer and Label-enhanced Task-adaptive Projection NetworkYutai Hou, Wanxiang Che, Yongkui Lai, Zhihan Zhou et al.ACL 2020 · 186 citations
- LFPT5: A Unified Framework for Lifelong Few-shot Language Learning Based on Prompt Tuning of T5Chengwei Qin, Shafiq R. JotyICLR 2022 · 128 citations
- Continual Relation Learning via Episodic Memory Activation and ReconsolidationXu Han, Yi Dai, Tianyu Gao, Yankai Lin et al.ACL 2020 · 92 citations
- Few-shot Learning for Multi-label Intent DetectionYutai Hou, Yongkui Lai, Yushan Wu, Wanxiang Che et al.AAAI 2021 · 60 citations
Related papers
- Few-shot Relation Extraction via Bayesian Meta-learning on Relation GraphsMeng Qu, Tianyu Gao, Louis-Pascal A. C. Xhonneux, Jian TangICML 2020 · 131 citations
- MapRE: An Effective Semantic Mapping Approach for Low-resource Relation ExtractionManqing Dong, Chunguang Pan, Zhipeng LuoEMNLP 2021 · 35 citations
- Few-Shot Knowledge Graph CompletionChuxu Zhang, Huaxiu Yao, Chao Huang, Meng Jiang et al.AAAI 2020 · 238 citations
- Multi-Modal Siamese Network for Few-Shot Knowledge Graph CompletionYuyang Wei, Wei Chen, Xiaofang Zhang, Pengpeng Zhao et al.ICDE 2024 · 9 citations
- Generative Adversarial Zero-Shot Relational Learning for Knowledge GraphsPengda Qin, Xin Wang, Wenhu Chen, Chunyun Zhang et al.AAAI 2020 · 93 citations
