Type-Less yet Type-Aware Inductive Link Prediction with Pretrained Language Models
Alessandro De Bellis, Salvatore Bufi, Giovanni Servedio, Vito Walter Anelli, Tommaso Di Noia, Eugenio Di Sciascio
Abstract
Inductive link prediction is emerging as a key paradigm for real-world knowledge graphs (KGs), where new entities frequently appear and models must generalize to them without retraining. Predicting links in a KG faces the challenge of guessing previously unseen entities by leveraging generalizable node features such as subgraph structure, type annotations, and ontological constraints. However, explicit type information is often lacking or incomplete. Even when available, type information in most KGs is often coarse-grained, sparse, and prone to errors due to human annotation. In this work, we explore the potential of pre-trained language models (PLMs) to enrich node representations with implicit type signals. We introduce TyleR, a Type-less yet type-awaRe approach for subgraph-based inductive link prediction that leverages PLMs for semantic enrichment. Experiments on standard benchmarks demonstrate that TyleR outperforms state-of-the-art baselines in scenarios with scarce type annotations and sparse graph connectivity. To ensure reproducibility, we share our code at https://github.com/sisinflab/tyler .
Ask about this paper
Your agent reads all of it.
Lune indexed this paper to the last equation, along with the top-tier papers that cite it. Ask a question and the answer quotes them.
Your agent calls
Luneget_paper_fulltext
Free to start. No credit card required.
Terminal
Install the CLIlune papers fulltext c0966bc0-c8f8-49ff-995c-321976344e6aBuilds on9
- Language Models are Few-Shot LearnersTom B. Brown, Benjamin Mann, Nick Ryder, Melanie Subbiah et al.NeurIPS 2020 · 64,255 citations
- Composition-based Multi-Relational Graph Convolutional NetworksShikhar Vashishth, Soumya Sanyal, Vikram Nitin, Partha P. TalukdarICLR 2020 · 1,105 citations
- Inductive Relation Prediction by Subgraph ReasoningKomal K. Teru, Etienne G. Denis, William L. HamiltonICML 2020 · 493 citations
- Topology-Aware Correlations Between Relations for Inductive Link Prediction in Knowledge GraphsJiajun Chen, Huarui He, Feng Wu, Jie WangAAAI 2021 · 161 citations
- Communicative Message Passing for Inductive Relation ReasoningSijie Mai, Shuangjia Zheng, Yuedong Yang, Haifeng HuAAAI 2021 · 136 citations
Related papers
- Inductive Entity Representations from Text via Link PredictionDaniel Daza, Michael Cochez, Paul GrothWWW 2021 · 129 citations
- THGB: A Comprehensive Benchmark for Text-attributed Heterogeneous GraphsLixin Zhou, Zemin Liu, Yuan Fang, Dan Niu et al.AAAI 2026
- Disconnected Emerging Knowledge Graph Oriented Inductive Link PredictionYufeng Zhang, Weiqing Wang, Hongzhi Yin, Pengpeng Zhao et al.ICDE 2023 · 16 citations
- UniLP: Unified Topology-aware Generative Framework for Link Prediction in Knowledge GraphBen Liu, Miao Peng, Wenjie Xu, Xu Jia et al.WWW 2024 · 9 citations
- A Framework for Adapting Pre-Trained Language Models to Knowledge Graph CompletionJustin Lovelace, Carolyn P. RoséEMNLP 2022 · 9 citations
