Attribute-Consistent Knowledge Graph Representation Learning for Multi-Modal Entity Alignment
Qian Li, Shu Guo, Yangyifei Luo, Cheng Ji, Lihong Wang, Jiawei Sheng, Jianxin Li
Abstract
The multi-modal entity alignment (MMEA) aims to find all equivalent entity pairs between multi-modal knowledge graphs (MMKGs). Rich attributes and neighboring entities are valuable for the alignment task, but existing works ignore contextual gap problems that the aligned entities have different numbers of attributes on specific modality when learning entity representations. In this paper, we propose a novel attribute-consistent knowledge graph representation learning framework for MMEA (ACK-MMEA) to compensate the contextual gaps through incorporating consistent alignment knowledge. Attribute-consistent KGs (ACKGs) are first constructed via multi-modal attribute uniformization with merge and generate operators so that each entity has one and only one uniform feature in each modality. The ACKGs are then fed into a relation-aware graph neural network with random dropouts, to obtain aggregated relation representations and robust entity representations. In order to evaluate the ACK-MMEA facilitated for entity alignment, we specially design a joint alignment loss for both entity and attribute evaluation. Extensive experiments conducted on two benchmark datasets show that our approach achieves excellent performance compared to its competitors.
Ask about this paper
Your agent reads all of it.
Lune indexed this paper to the last equation, along with the top-tier papers that cite it. Ask a question and the answer quotes them.
Your agent calls
Luneget_paper_fulltext
Free to start. No credit card required.
Terminal
Install the CLIlune papers fulltext 959ca2db-aa3f-472d-a29b-ae5d385557b3Cited by top-tier papers16
- TMac: Temporal Multi-Modal Graph Learning for Acoustic Event ClassificationMeng Liu, Ke Liang, Dayu Hu, Hao Yu et al.ACM MM 2023 · 34 citations
- Fewer Steps, Better Performance: Efficient Cross-Modal Clip Trimming for Video Moment Retrieval Using LanguageXiang Fang, Daizong Liu, Wanlong Fang, Pan Zhou et al.AAAI 2024 · 30 citations
- Towards Unifying Multi-Lingual and Cross-Lingual SummarizationJiaan Wang, Fandong Meng, Duo Zheng, Yunlong Liang et al.ACL 2023 · 24 citations
- Pseudo-Label Calibration Semi-supervised Multi-Modal Entity AlignmentLuyao Wang, Pengnian Qi, Xigang Bao, Chunlai Zhou et al.AAAI 2024 · 21 citations
- Tackling Uncertain Correspondences for Multi-Modal Entity AlignmentLiyi Chen, Ying Sun, Shengzhe Zhang, Yuyang Ye et al.NeurIPS 2024 · 20 citations
Builds on7
- Graph Contrastive Learning with AugmentationsYuning You, Tianlong Chen, Yongduo Sui, Ting Chen et al.NeurIPS 2020 · 3,042 citations
- Self-supervised Graph Learning for RecommendationJiancan Wu, Xiang Wang, Fuli Feng, Xiangnan He et al.SIGIR 2021 · 1,476 citations
- Knowledge Graph Alignment Network with Gated Multi-Hop Neighborhood AggregationZequn Sun, Chengming Wang, Wei Hu, Muhao Chen et al.AAAI 2020 · 379 citations
- Visual Pivoting for (Unsupervised) Entity AlignmentFangyu Liu, Muhao Chen, Dan Roth, Nigel CollierAAAI 2021 · 159 citations
- Neighborhood Matching Network for Entity AlignmentYuting Wu, Xiao Liu, Yansong Feng, Zheng Wang et al.ACL 2020 · 122 citations
Related papers
- Multi-modal Siamese Network for Entity AlignmentLiyi Chen, Zhi Li, Tong Xu, Han Wu et al.KDD 2022 · 82 citations
- Enhancing Multi-Modal Entity Alignment via Multi-Grained Decision FusionYu Xing, Qizhuo Xie, You Lv, Ziyang Zhou et al.WWW 2026
- Explicit-Implicit Entity Alignment Method in Multi-modal Knowledge GraphsLuyao Wang, Chunlai Zhou, Biao QinKDD 2025
- Towards Semantic Consistency: Dirichlet Energy Driven Robust Multi-Modal Entity AlignmentYuanyi Wang, Haifeng Sun, Jiabo Wang, Jingyu Wang et al.ICDE 2024 · 13 citations
- Cross-Modal Graph Attention Network for Entity AlignmentBaogui Xu, Chengjin Xu, Bing SuACM MM 2023 · 21 citations
