Mixture of Length and Pruning Experts for Knowledge Graphs Reasoning
Enjun Du, Siyi Liu, Yongqi Zhang
Abstract
Knowledge Graph (KG) reasoning, which aims to infer new facts from structured knowledge repositories, plays a vital role in Natural Language Processing (NLP) systems. Its effectiveness critically depends on constructing informative and contextually relevant reasoning paths. However, existing graph neural networks (GNNs) often adopt rigid, query-agnostic pathexploration strategies, limiting their ability to adapt to diverse linguistic contexts and semantic nuances. To address these limitations, we propose MoKGR, a mixture-of-experts framework that personalizes path exploration through two complementary components: (1) a mixture of length experts that adaptively selects and weights candidate path lengths according to query complexity, providing query-specific reasoning depth; and (2) a mixture of pruning experts that evaluates candidate paths from a complementary perspective, retaining the most informative paths for each query. Through comprehensive experiments on diverse benchmark, MoKGR demonstrates superior performance in both transductive and inductive settings, validating the effectiveness of personalized path exploration in KGs reasoning. 1 * Corresponding author 1 Code is available on https://github.com/EnjunDu/ MoKGR . (JACK, followed, ?) to find Chirs Evans naturally concludes within three hops. Conversely, addressing the query (JACK, watched, ?) to identify Avengers: Endgame might require exploration beyond three hops to capture critical relationships. These scenarios underscore the need for hop-level personalization, tailoring path exploration to query complexity to improve reasoning efficiency and accuracy.
Ask about this paper
Your agent reads all of it.
Lune indexed this paper to the last equation, along with the top-tier papers that cite it. Ask a question and the answer quotes them.
Cited by top-tier papers4
- GraphMaster: Automated Graph Synthesis via LLM Agents in Data-Limited EnvironmentsEnjun Du, Xunkai Li, Tian Jin, Zhihan Zhang et al.NeurIPS 2025 · 25 citations
- GraphOracle: Efficient Fully-Inductive Knowledge Graph Reasoning via Relation-Dependency GraphsEnjun Du, Siyi Liu, Yongqi ZhangAAAI 2026 · 3 citations
- Noise-Aware Graph-Based Cognitive Diagnostic Framework Through Low-Rank AlignmentGuixian Zhang, Yanmei Zhang, Guan Yuan, Shang Liu et al.AAAI 2026
- VideoSeg-R1: Reasoning Video Object Segmentation via Reinforcement LearningZishan Xu, Yifu Guo, Yuquan Lu, Fengyu Yang et al.AAAI 2026
Builds on23
- GShard: Scaling Giant Models with Conditional Computation and Automatic ShardingDmitry Lepikhin, HyoukJoong Lee, Yuanzhong Xu, Dehao Chen et al.ICLR 2021 · 1,954 citations
- Composition-based Multi-Relational Graph Convolutional NetworksShikhar Vashishth, Soumya Sanyal, Vikram Nitin, Partha P. TalukdarICLR 2020 · 1,105 citations
- Neural Bellman-Ford Networks: A General Graph Neural Network Framework for Link PredictionZhaocheng Zhu, Zuobai Zhang, Louis-Pascal A. C. Xhonneux, Jian TangNeurIPS 2021 · 546 citations
- Inductive Relation Prediction by Subgraph ReasoningKomal K. Teru, Etienne G. Denis, William L. HamiltonICML 2020 · 493 citations
- Multimodal Contrastive Learning with LIMoE: the Language-Image Mixture of ExpertsBasil Mustafa, Carlos Riquelme, Joan Puigcerver, Rodolphe Jenatton et al.NeurIPS 2022 · 359 citations
Related papers
- Enhancing Logical Expressiveness in Graph Neural Networks via Path-Neighbor AggregationHan Yu, Xiaojuan Zhao, Aiping Li, Kai Chen et al.AAAI 2026
- Multiple Heads are Better than One: Mixture of Modality Knowledge Experts for Entity Representation LearningYichi Zhang, Zhuo Chen, Lingbing Guo, Yajing Xu et al.ICLR 2025 · 1 citation
- AdaRPT: An Adaptive Rule Pattern Transfer Model for Fully Inductive Knowledge Graph ReasoningZhiwen Xie, Zhuo Zhao, Jinjin Ma, Guangyou Zhou et al.SIGIR 2025 · 3 citations
- Efficient Probabilistic Logic Reasoning with Graph Neural NetworksYuyu Zhang, Xinshi Chen, Yuan Yang, Arun Ramamurthy et al.ICLR 2020 · 119 citations
- Mask and Reason: Pre-Training Knowledge Graph Transformers for Complex Logical QueriesXiao Liu, Shiyu Zhao, Kai Su, Yukuo Cen et al.KDD 2022 · 38 citations
