Enhancing Logical Expressiveness in Graph Neural Networks via Path-Neighbor Aggregation
Han Yu, Xiaojuan Zhao, Aiping Li, Kai Chen, Ziniu Liu, Zhichao Peng
Abstract
Graph neural networks (GNNs) can effectively model structural information of graphs, making them widely used in knowledge graph (KG) reasoning. However, existing studies on the expressive power of GNNs mainly focuses on simple single-relation graphs, and there is still insufficient discussion on the power of GNN to express logical rules in KGs. How to enhance the logical expressive power of GNNs is still a key issue. Motivated by this, we propose Path-Neighbor enhanced GNN (PN-GNN), a method to enhance the logical expressive power of GNN by aggregating nodeneighbor embeddings on the reasoning path. First, we analyze the logical expressive power of existing GNN-based methods and point out the shortcomings of the expressive power of these methods. Then, we theoretically investigate the logical expressive power of PN-GNN, showing that it not only has strictly stronger expressive power than C-GNN but also that its (k + 1)-hop logical expressiveness is strictly superior to that of k-hop. Finally, we evaluate the logical expressive power of PN-GNN on eight synthetic datasets and two real-world datasets. Both theoretical analysis and extensive experiments confirm that PN-GNN enhances the expressive power of logical rules without compromising generalization, as evidenced by its competitive performance in KG reasoning tasks.
Ask about this paper
Your agent reads all of it.
Lune indexed this paper to the last equation, along with the top-tier papers that cite it. Ask a question and the answer quotes them.
Your agent calls
Luneget_paper_fulltext
Free to start. No credit card required.
Terminal
Install the CLIlune papers fulltext d5d70821-4106-4b1d-b9f2-c6b0935b634fBuilds on15
- Composition-based Multi-Relational Graph Convolutional NetworksShikhar Vashishth, Soumya Sanyal, Vikram Nitin, Partha P. TalukdarICLR 2020 · 1,105 citations
- Principal Neighbourhood Aggregation for Graph NetsGabriele Corso, Luca Cavalleri, Dominique Beaini, Pietro Liò et al.NeurIPS 2020 · 914 citations
- Neural Bellman-Ford Networks: A General Graph Neural Network Framework for Link PredictionZhaocheng Zhu, Zuobai Zhang, Louis-Pascal A. C. Xhonneux, Jian TangNeurIPS 2021 · 546 citations
- Inductive Relation Prediction by Subgraph ReasoningKomal K. Teru, Etienne G. Denis, William L. HamiltonICML 2020 · 493 citations
- Learning Hierarchy-Aware Knowledge Graph Embeddings for Link PredictionZhanqiu Zhang, Jianyu Cai, Yongdong Zhang, Jie WangAAAI 2020 · 481 citations
Related papers
- Understanding Expressivity of GNN in Rule LearningHaiquan Qiu, Yongqi Zhang, Yong Li, Quanming YaoICLR 2024 · 10 citations
- Efficient Probabilistic Logic Reasoning with Graph Neural NetworksYuyu Zhang, Xinshi Chen, Yuan Yang, Arun Ramamurthy et al.ICLR 2020 · 119 citations
- Sound Logical Explanations for Mean Aggregation Graph Neural NetworksMatthew Morris, Ian HorrocksNeurIPS 2025 · 3 citations
- Rule-Guided Compositional Representation Learning on Knowledge GraphsGuanglin Niu, Yongfei Zhang, Bo Li, Peng Cui et al.AAAI 2020 · 70 citations
- Path Neural Networks: Expressive and Accurate Graph Neural NetworksGaspard Michel, Giannis Nikolentzos, Johannes F. Lutzeyer, Michalis VazirgiannisICML 2023 · 45 citations
