BoxE: A Box Embedding Model for Knowledge Base Completion
Ralph Abboud, Ismail Ilkan Ceylan, Thomas Lukasiewicz, Tommaso Salvatori
Abstract
Knowledge base completion (KBC) aims to automatically infer missing facts by exploiting information already present in a knowledge base (KB). A promising approach for KBC is to embed knowledge into latent spaces and make predictions from learned embeddings. However, existing embedding models are subject to at least one of the following limitations: (1) theoretical inexpressivity, (2) lack of support for prominent inference patterns (e.g., hierarchies), (3) lack of support for KBC over higher-arity relations, and (4) lack of support for incorporating logical rules. Here, we propose a spatio-translational embedding model, called BoxE, that simultaneously addresses all these limitations. BoxE embeds entities as points, and relations as a set of hyper-rectangles (or boxes), which spatially characterize basic logical properties. This seemingly simple abstraction yields a fully expressive model offering a natural encoding for many desired logical properties. BoxE can both capture and inject rules from rich classes of rule languages, going well beyond individual inference patterns. By design, BoxE naturally applies to higher-arity KBs. We conduct a detailed experimental analysis, and show that BoxE achieves state-of-the-art performance, both on benchmark knowledge graphs and on more general KBs, and we empirically show the power of integrating logical rules. Currently, the main embedding approaches for KBC are translational models [4, 37] , which score facts based on distances in the embedding space, bilinear models [39, 49, 1], which learn embeddings that factorize the truth tensor of a knowledge base, and neural models [8, 34, 29] , which score facts using dedicated neural architectures. Each of these models suffer from limitations, most of 34th Conference on Neural Information Processing Systems (NeurIPS 2020),
Ask about this paper
Your agent reads all of it.
Lune indexed this paper to the last equation, along with the top-tier papers that cite it. Ask a question and the answer quotes them.
Cited by top-tier papers43
- Temporal Knowledge Graph Completion Using Box EmbeddingsJohannes Messner, Ralph Abboud, Ismail Ilkan CeylanAAAI 2022 · 138 citations
- Answering Complex Queries in Knowledge Graphs with Bidirectional Sequence EncodersBhushan Kotnis, Carolin Lawrence, Mathias NiepertAAAI 2021 · 48 citations
- Joint Knowledge Graph Completion and Question AnsweringLihui Liu, Boxin Du, Jiejun Xu, Yinglong Xia et al.KDD 2022 · 46 citations
- Rot-Pro: Modeling Transitivity by Projection in Knowledge Graph EmbeddingTengwei Song, Jie Luo, Lei HuangNeurIPS 2021 · 46 citations
- UniKER: A Unified Framework for Combining Embedding and Definite Horn Rule Reasoning for Knowledge Graph InferenceKewei Cheng, Ziqing Yang, Ming Zhang, Yizhou SunEMNLP 2021 · 37 citations
Builds on3
- Query2box: Reasoning over Knowledge Graphs in Vector Space Using Box EmbeddingsHongyu Ren, Weihua Hu, Jure LeskovecICLR 2020 · 355 citations
- You CAN Teach an Old Dog New Tricks! On Training Knowledge Graph EmbeddingsDaniel Ruffinelli, Samuel Broscheit, Rainer GemullaICLR 2020 · 238 citations
- Generalizing Tensor Decomposition for N-ary Relational Knowledge BasesYu Liu, Quanming Yao, Yong LiWWW 2020 · 91 citations
Related papers
- ExpressivE: A Spatio-Functional Embedding For Knowledge Graph CompletionAleksandar Pavlovic, Emanuel SallingerICLR 2023 · 12 citations
- Simple but Effective Compound Geometric Operations for Temporal Knowledge Graph CompletionRui Ying, Mengting Hu, Jianfeng Wu, Yalan Xie et al.ACL 2024
- TranSHER: Translating Knowledge Graph Embedding with Hyper-Ellipsoidal RestrictionYizhi Li, Wei Fan, Chao Liu, Chenghua Lin et al.EMNLP 2022 · 7 citations
- Dual Box Embeddings for the Description Logic EL++Mathias Jackermeier, Jiaoyan Chen, Ian HorrocksWWW 2024 · 29 citations
- Hybrid Interaction Temporal Knowledge Graph Embedding Based on Householder TransformationsSensen Zhang, Xun Liang, Hui Tang, Zhenyu GuanACM MM 2023 · 6 citations
