Lune

WWW2026顶会

Relation-Aware Multimodal Analogical Reasoning with Modality Fingerprints and Adaptive Gating

Ruofan Wang, Zijian Huang, Qiqi Wang, Yuchen Su, Robert Amor, Kaiqi Zhao, Meng-Fen Chiang

2026年份

摘要

Analogical reasoning over Multimodal Knowledge Graphs (MMKGs) couples abductive relation induction with inductive tail completion. However, existing approaches rely on static fusion mechanisms that overlook the inherent asymmetry of modal relevance: while visual cues elucidate concrete entities, they are often noisy or irrelevant for abstract concepts, where text and graph structure provide decisive signals. Furthermore, prior methods fail to enforce consistency between induced relations and the modality patterns implied by the analogical context. To bridge this gap, we introduce RMAR, a Relation-aware Multimodal Analogical Reasoning framework with two complementary paths. An explicit path estimates modality fingerprints to score compatibility during relation induction and guide fusion during tail completion. An implicit path employs adaptive gating to blend structural, textual, and visual signals conditioned on the specific query context. To address the limitations of current benchmarks, which overrepresent concrete entities, we release MCNetAnalogy, and its companion graph, MCNetKG, a rigorous dataset enriched with abstract concepts and actions. RMAR is backbone-agnostic and works with multimodal knowledge graph embedding (MKGE) and transformer-based (MPT) pipelines. Extensive experiments demonstrate that RMAR delivers consistent gains across both embedding-based and transformer-based backbones, achieving a 29% relative improvement on MCNetAnalogy. Ablation studies confirm that RMAR's relation-aware modulation is particularly effective when modal evidence is weak or ambiguous.

问问这篇 Paper

问问你的智能体。

Lune 读过与它相关的顶会 Paper,每个回答都会注明依据哪几篇。

可以从这些问题问起

智能体调用

Lunesearch_papers

在 Lune 里问

免费开始,无需绑卡

相关 Paper

黄昏的海面,两侧是细线勾勒的悬崖