Multimodal Knowledge Graph Completion via Relation-Aware Negative Sampling with Diffusion-based Interpolation
Qian Ma, Linfei Dai, Zhongming Yao, Yu Gu, Tianyi Li, Christian S. Jensen, Ge Yu
摘要
Multimodal Knowledge Graphs (MMKGs) enable structured reasoning across heterogeneous modalities and are essential infrastructure for data management and analytics. As MMKGs are inherently incomplete and generally contain noisy data, MMKG Completion (MMKGC) is a central task for improving data quality and semantic inference. Specifically, a crucial aspect of MMKGC is negative sampling , which impacts model discriminability and completion accuracy. However, existing negative sampling proposals often ignore the semantic properties of relation types and lack mechanisms for adaptive control of negative sample hardness, leading to suboptimal MMKGC performance. To address issues such as these, we propose RelDINS that improves semantic consistency and robustness by performing relation-type-aware negative sampling through diffusion-based interpolation. RelDINS incorporates two modules: (i) a Relation-type-aware Multimodal Embedding Learning (RMEL) module that adaptively injects relational semantics into entity representations based on cardinality constraints; (ii) and a Diffusion-based Interpolation Negative Sampling (DINS) module that dynamically generates hardness-tunable negative samples via spherical linear interpolation in diffusion noise space. Extensive experiments on three public benchmarks show that RelDINS achieves state-of-the-art performance, with average improvements of 3.5% in MRR, 5.0% in Hit@1, 2.6% in Hit@3, and 1.4% in Hit@10 over leading baselines. Supported by a complexity analysis and an empirical study, RelDINS is a principled and scalable solution to enhancing semantic consistency and data reliability in MMKGC.
问问这篇 Paper
智能体会读完全文。
Lune 把这篇 Paper 索引到了每一个公式,引用它的顶会 Paper 也一样。你提问,回答直接引用原文。
它引用的顶会 Paper22
- Denoising Diffusion Probabilistic ModelsJonathan Ho, Ajay Jain, Pieter AbbeelNeurIPS 2020 · 被引用 35,902 次
- Understanding Negative Sampling in Graph Representation LearningZhen Yang, Ming Ding, Chang Zhou, Hongxia Yang 等KDD 2020 · 被引用 172 次
- Is Visual Context Really Helpful for Knowledge Graph? A Representation Learning PerspectiveMeng Wang, Sen Wang, Han Yang, Zheng Zhang 等ACM MM 2021 · 被引用 129 次
- OTKGE: Multi-modal Knowledge Graph Embeddings via Optimal TransportZongsheng Cao, Qianqian Xu, Zhiyong Yang, Yuan He 等NeurIPS 2022 · 被引用 117 次
- Orthogonal Relation Transforms with Graph Context Modeling for Knowledge Graph EmbeddingYun Tang, Jing Huang, Guangtao Wang, Xiaodong He 等ACL 2020 · 被引用 92 次
相关 Paper
- Relation-enhanced Negative Sampling for Multimodal Knowledge Graph CompletionDerong Xu, Tong Xu, Shiwei Wu, Jingbo Zhou 等ACM MM 2022 · 被引用 89 次
- DANS-KGC: Diffusion Based Adaptive Negative Sampling for Knowledge Graph CompletionHaoning Li, Qinghua HuangAAAI 2026
- ARNS: Adaptive Relation-Aware Negative Sampling with Curriculum Learning for Inductive Knowledge Graph CompletionLing Ding, Zhizhi Yu, Di Jin, Lei HuangAAAI 2026
- HFR-MKGC: Hierarchical Fusion Reasoning with MLLMs for Multi-modal Knowledge Graph CompletionDi Wang, Junping Du, Zhe Xue, Meiyu Liang 等AAAI 2026
- APKGC: Noise-enhanced Multi-Modal Knowledge Graph Completion with Attention PenaltyYue Jian, Xiangyu Luo, Zhifei Li, Miao Zhang 等AAAI 2025 · 被引用 21 次
