Learning Representations of Bi-level Knowledge Graphs for Reasoning beyond Link Prediction

Knowledge graphs represent known facts using triplets. While existing knowledge graph embedding methods only consider the connections between entities, we propose considering the relationships between triplets. For example, let us consider two triplets T1 and T2 where T1 is (Academy Awards, Nominates, Avatar) and T2 is (Avatar, Wins, Academy Awards). Given these two base-level triplets, we see that T1 is a prerequisite for T2. In this paper, we define a higher-level triplet to represent a relationship between triplets, e.g., ⟨T1, PrerequisiteFor, T2⟩ where Prerequisite-For is a higher-level relation. We define a bi-level knowledge graph that consists of the base-level and the higher-level triplets. We also propose a data augmentation strategy based on the random walks on the bi-level knowledge graph to augment plausible triplets. Our model called BiVE learns embeddings by taking into account the structures of the base-level and the higher-level triplets, with additional consideration of the augmented triplets. We propose two new tasks: triplet prediction and conditional link prediction. Given a triplet T1 and a higher-level relation, the triplet prediction predicts a triplet that is likely to be connected to T1 by the higher-level relation, e.g., ⟨T1, PrerequisiteFor, ?⟩. The conditional link prediction predicts a missing entity in a triplet conditioned on another triplet, e.g., ⟨T1, PrerequisiteFor, (Avatar, Wins, ?)⟩. Experimental results show that BiVE significantly outperforms all other methods in the two new tasks and the typical baselevel link prediction in real-world bi-level knowledge graphs.