KEML: A Knowledge-Enriched Meta-Learning Framework for Lexical Relation Classification
Chengyu Wang, Minghui Qiu, Jun Huang, Xiaofeng He
Abstract
Lexical relations describe how concepts are semantically related, in the form of relation triples. The accurate prediction of lexical relations between concepts is challenging, due to the sparsity of patterns indicating the existence of such relations. We propose the Knowledge-Enriched Meta-Learning (KEML) framework to address lexical relation classification. In KEML, the LKB-BERT (Lexical Knowledge Base-BERT) model is first presented to learn concept representations from text corpora, with rich lexical knowledge injected by distant supervision. A probabilistic distribution of auxiliary tasks is defined to increase the model's ability to recognize different types of lexical relations. We further propose a neural classifier integrated with special relation recognition cells, in order to combine meta-learning over the auxiliary task distribution and supervised learning for LRC. Experiments over multiple datasets show KEML outperforms state-of-the-art methods.
Ask about this paper
Your agent reads all of it.
Lune indexed this paper to the last equation, along with the top-tier papers that cite it. Ask a question and the answer quotes them.
Cited by top-tier papers5
- Meta Fine-Tuning Neural Language Models for Multi-Domain Text MiningChengyu Wang, Minghui Qiu, Jun Huang, Xiaofeng HeEMNLP 2020 · 19 citations
- No clues good clues: out of context Lexical Relation ClassificationLucia Pitarch, Jordi Bernad, Lacramioara Dranca, Carlos Bobed Lisbona et al.ACL 2023 · 4 citations
- Meta Distant Transfer Learning for Pre-trained Language ModelsChengyu Wang, Haojie Pan, Minghui Qiu, Jun Huang et al.EMNLP 2021 · 3 citations
- Introducing Graph Context into Language Models through Parameter-Efficient Fine-Tuning for Lexical Relation MiningJingwen Sun, Zhiyi Tian, Yu He, Jingwei Sun et al.ACL 2025
- Enhancing Lexical Relation Mining with Structured Sememe KnowledgeHansi Wang, Qiliang Liang, Yue Wang, Yang LiuACL 2026
Builds on3
- ALBERT: A Lite BERT for Self-supervised Learning of Language RepresentationsZhenzhong Lan, Mingda Chen, Sebastian Goodman, Kevin Gimpel et al.ICLR 2020 · 7,418 citations
- K-BERT: Enabling Language Representation with Knowledge GraphWeijie Liu, Peng Zhou, Zhe Zhao, Zhiruo Wang et al.AAAI 2020 · 898 citations
- Pretrained Encyclopedia: Weakly Supervised Knowledge-Pretrained Language ModelWenhan Xiong, Jingfei Du, William Yang Wang, Veselin StoyanovICLR 2020 · 215 citations
Related papers
- Inducing Relational Knowledge from BERTZied Bouraoui, José Camacho-Collados, Steven SchockaertAAAI 2020 · 183 citations
- Enhancing Multilingual Language Model with Massive Multilingual Knowledge TriplesLinlin Liu, Xin Li, Ruidan He, Lidong Bing et al.EMNLP 2022 · 15 citations
- Few-shot Text Classification with Distributional SignaturesYujia Bao, Menghua Wu, Shiyu Chang, Regina BarzilayICLR 2020 · 183 citations
- Learning Term Embeddings for Lexical TaxonomiesJingping Liu, Menghui Wang, Chao Wang, Jiaqing Liang et al.AAAI 2021 · 6 citations
- Verb Metaphor Detection via Contextual Relation LearningWei Song, Shuhui Zhou, Ruiji Fu, Ting Liu et al.ACL 2021
