Multi-view Contrastive Learning for Entity Typing over Knowledge Graphs
Zhiwei Hu, Víctor Gutiérrez-Basulto, Zhiliang Xiang, Ru Li, Jeff Z. Pan
Abstract
Knowledge graph entity typing (KGET) aims at inferring plausible types of entities in knowledge graphs. Existing approaches to KGET focus on how to better encode the knowledge provided by the neighbors and types of an entity into its representation. However, they ignore the semantic knowledge provided by the way in which types can be clustered together. In this paper, we propose a novel method called Multi-view Contrastive Learning for knowledge graph Entity Typing (MCLET), which effectively encodes the coarse-grained knowledge provided by clusters into entity and type embeddings. MCLET is composed of three modules: i) Multi-view Generation and Encoder module, which encodes structured information from entity-type, entity-cluster and cluster-type views; ii) Cross-view Contrastive Learning module, which encourages different views to collaboratively improve view-specific representations of entities and types; iii) Entity Typing Prediction module, which integrates multi-head attention and a Mixture-of-Experts strategy to infer missing entity types. Extensive experiments show the strong performance of MCLET compared to the state-of-the-art.
Ask about this paper
Your agent reads all of it.
Lune indexed this paper to the last equation, along with the top-tier papers that cite it. Ask a question and the answer quotes them.
Your agent calls
Luneget_paper_fulltext
Free to start. No credit card required.
Terminal
Install the CLIlune papers fulltext b8930c5f-b1ae-462c-a1df-6ac1048a352bCited by top-tier papers1
Ask how each one uses itBuilds on10
- LightGCN: Simplifying and Powering Graph Convolution Network for RecommendationXiangnan He, Kuan Deng, Xiang Wang, Yan Li et al.SIGIR 2020 · 4,448 citations
- Graph Contrastive Learning with Adaptive AugmentationYanqiao Zhu, Yichen Xu, Feng Yu, Qiang Liu et al.WWW 2021 · 1,415 citations
- Composition-based Multi-Relational Graph Convolutional NetworksShikhar Vashishth, Soumya Sanyal, Vikram Nitin, Partha P. TalukdarICLR 2020 · 1,105 citations
- Hybrid Transformer with Multi-level Fusion for Multimodal Knowledge Graph CompletionXiang Chen, Ningyu Zhang, Lei Li, Shumin Deng et al.SIGIR 2022 · 227 citations
- Multi-level Cross-view Contrastive Learning for Knowledge-aware Recommender SystemDing Zou, Wei Wei, Xian-Ling Mao, Ziyang Wang et al.SIGIR 2022 · 226 citations
Related papers
- AsyncET: Asynchronous Representation Learning for Knowledge Graph Entity TypingYun-Cheng Wang, Xiou Ge, Bin Wang, C.-C. Jay KuoKDD 2024 · 4 citations
- A Good Neighbor, A Found Treasure: Mining Treasured Neighbors for Knowledge Graph Entity TypingZhuoran Jin, Pengfei Cao, Yubo Chen, Kang Liu et al.EMNLP 2022 · 6 citations
- Transformer-based Entity Typing in Knowledge GraphsZhiwei Hu, Víctor Gutiérrez-Basulto, Zhiliang Xiang, Ru Li et al.EMNLP 2022 · 16 citations
- Contrast then Memorize: Semantic Neighbor Retrieval-Enhanced Inductive Multimodal Knowledge Graph CompletionYu Zhao, Ying Zhang, Baohang Zhou, Xinying Qian et al.SIGIR 2024 · 15 citations
- Connecting Embeddings for Knowledge Graph Entity TypingYu Zhao, Anxiang Zhang, Ruobing Xie, Kang Liu et al.ACL 2020 · 62 citations
