MoEMeta: Mixture-of-Experts Meta Learning for Few-Shot Relational Learning
Han Wu, Jie Yin
Abstract
Few-shot knowledge graph relational learning seeks to perform reasoning over relations given only a limited number of training examples. While existing approaches largely adopt a meta-learning framework for enabling fast adaptation to new relations, they suffer from two key pitfalls. First, they learn relation metaknowledge in isolation, failing to capture common relational patterns shared across tasks. Second, they struggle to effectively incorporate local, task-specific contexts crucial for rapid adaptation. To address these limitations, we propose MoEMeta, a novel meta-learning framework that disentangles globally shared knowledge from task-specific contexts to enable both effective model generalization and rapid adaptation. MoEMeta introduces two key innovations: (i) a mixture-of-experts (MoE) model that learns globally shared relational prototypes to enhance generalization, and (ii) a task-tailored adaptation mechanism that captures local contexts for fast task-specific adaptation. By balancing global generalization with local adaptability, MoEMeta significantly advances few-shot relational learning. Extensive experiments and analyses on three KG benchmarks show that MoEMeta consistently outperforms existing baselines, achieving state-of-the-art performance. 1
Ask about this paper
Your agent reads all of it.
Lune indexed this paper to the last equation, along with the top-tier papers that cite it. Ask a question and the answer quotes them.
Your agent calls
Luneget_paper_fulltext
Free to start. No credit card required.
Terminal
Install the CLIlune papers fulltext 25cff15d-4f27-475d-8180-50722a5f868dBuilds on14
- Mixture-of-Experts with Expert Choice RoutingYanqi Zhou, Tao Lei, Hanxiao Liu, Nan Du et al.NeurIPS 2022 · 933 citations
- From Sparse to Soft Mixtures of ExpertsJoan Puigcerver, Carlos Riquelme Ruiz, Basil Mustafa, Neil HoulsbyICLR 2024 · 264 citations
- Few-Shot Knowledge Graph CompletionChuxu Zhang, Huaxiu Yao, Chao Huang, Meng Jiang et al.AAAI 2020 · 238 citations
- Adaptive Attentional Network for Few-Shot Knowledge Graph CompletionJiawei Sheng, Shu Guo, Zhenyu Chen, Juwei Yue et al.EMNLP 2020 · 117 citations
- Relational Learning with Gated and Attentive Neighbor Aggregator for Few-Shot Knowledge Graph CompletionGuanglin Niu, Yang Li, Chengguang Tang, Ruiying Geng et al.SIGIR 2021 · 90 citations
Related papers
- Meta-Semantics Augmented Few-Shot Relational LearningHan Wu, Jie YinEMNLP 2025
- Context-Aware Adapter Tuning for Few-Shot Relation Learning in Knowledge GraphsLiu Ran, Zhongzhou Liu, Xiaoli Li, Yuan FangEMNLP 2024 · 1 citation
- Learning to Sample and Aggregate: Few-shot Reasoning over Temporal Knowledge GraphsRuijie Wang, Zheng Li, Dachun Sun, Shengzhong Liu et al.NeurIPS 2022 · 61 citations
- Automated Relational Meta-learningHuaxiu Yao, Xian Wu, Zhiqiang Tao, Yaliang Li et al.ICLR 2020 · 102 citations
- Few-shot Relation Extraction via Bayesian Meta-learning on Relation GraphsMeng Qu, Tianyu Gao, Louis-Pascal A. C. Xhonneux, Jian TangICML 2020 · 131 citations
