Towards Foundation Models for MMKG: Multi-Task Inductive Generalization via Task-Aware Routing
Shundong Yang, Jing Yang, Xiaowen Jiang, Xiaofen Wang, Laurence T. Yang, Yuan Gao, Xinfa Jiang, Jie Chen, Chaojun Zhang
Abstract
Multimodal knowledge graphs (MMKG) extend the representational capacity of conventional knowledge graphs by integrating multimodal contexts. However, despite increasing attention on core tasks—multimodal link prediction (MMLP), multimodal entity alignment (MMEA), and multimodal entity linking (MMEL)—most existing approaches remain confined to meticulously tailored, task-specific and graph-specific paradigms, limiting their practicality in dynamic environments where tasks co-exist and new knowledge graphs continually emerge. In this work, we propose the first unified multi-task inductive inference framework for (MtaIMKG) that can handle multiple core tasks, with universality and transferability to any unseen MMKG, by tackling inherent heterogeneities: i) Feature Heterogeneity: Bridging the semantic gaps in feature representations across domains. ii) Structural Heterogeneity: Overcoming structural divergence in topology across graphs. iii) Task Heterogeneity: Reconciling conflicting objectives and inductive biases across tasks. To address the above challenges, we center on reconciling divergent representation preferences across tasks, delivering only task-pertinent information instead of engaging in indiscriminate aggregation. Specifically, we introduce a task-aware routing network that dynamically integrates and routes multimodal representations, assesses their contributions under task semantics, and produces adaptive, task-conditioned representations for any input graph. In addition, MtaIMKG employs a gated mixture-of-experts to suppress cross-modal noise and extract complementary information across tasks. These strategies tackle the notable heterogeneity challenges in multi-task inductive inference on MMKG, enabling MtaIMKG to effectively zero-shot generalize to any unseen graph. Extensive experiments demonstrate that MtaIMKG achieves SOTA performance in both multi-task inductive and transductive inference with competitive efficiency, confirming its value as a scalable and generalizable solution for MMKG reasoning. Our code is released at https://github.com/MMKGer/MtaIMKG/.
Ask about this paper
Ask your agent about it.
Lune has read the top-tier papers around this one, so every answer names the papers it rests on.
Your agent calls
Lunesearch_papers
Free to start. No credit card required.
Terminal
Install the CLIlune papers get f70deb4e-5f1e-47ef-bb17-70b9899478b6Related papers
- Towards Multimodal Inductive Learning: Adaptively Embedding MMKG via PrototypesShundong Yang, Jing Yang, Xiaowen Jiang, Yuan Gao et al.WWW 2025 · 3 citations
- Attribute-Consistent Knowledge Graph Representation Learning for Multi-Modal Entity AlignmentQian Li, Shu Guo, Yangyifei Luo, Cheng Ji et al.WWW 2023 · 56 citations
- Multiple Heads are Better than One: Mixture of Modality Knowledge Experts for Entity Representation LearningYichi Zhang, Zhuo Chen, Lingbing Guo, Yajing Xu et al.ICLR 2025 · 1 citation
- MMKGR: Multi-hop Multi-modal Knowledge Graph ReasoningShangfei Zheng, Weiqing Wang, Jianfeng Qu, Hongzhi Yin et al.ICDE 2023 · 40 citations
- Towards Foundation Models for Knowledge Graph ReasoningMikhail Galkin, Xinyu Yuan, Hesham Mostafa, Jian Tang et al.ICLR 2024 · 95 citations
