GeoKGM: A Multimodal Large Language Model for Zero-Shot Knowledge Graph Completion in Geospatial Databases
Zhihan Zheng, Haitao Yuan, Minxiao Chen, Nan Jiang, Haoning Wang, Shangguang Wang
摘要
Geospatial Knowledge Graphs (KGs) are widely used data structures that integrate rich knowledge from multi-source databases and play a crucial role in applications such as data retrieval and urban management. However, existing methods for Geospatial Knowledge Graph Completion (KGC) heavily rely on extensive labeled data and lack the ability to direct inference on new unlabeled geospatial databases and thus limiting their practical deployment. To address this limitation, this paper first formalizes a novel zero-shot transfer scenario and then proposes an innovative geospatial multimodal large language model framework capable of efficient Geospatial KGC with robust zero-shot generalization capabilities. Specifically, to enable effective direct inference under significant data discrepancies inherent in zero-shot scenarios, we introduce large language models (LLMs) into the geospatial KGC problem for the first time and redefine the multimodal data processing paradigm for geospatial LLMs. Next, to overcome the challenge that LLMs cannot directly handle geospatial data, we innovatively propose a Pretrain Geospatial Encoder that performs self-supervised pretraining exclusively on spatial data. Additionally, to integrate geospatial and textual modalities, we design an adaptation component that injects geospatial features into the LLMs and introduce a multi-task fine-tuning procedure. Lastly, to ensure robustness across multi-target domain scenarios, we present an implicit data alignment strategy based on adversarial learning. Extensive evaluations conducted on four real-world datasets demonstrate that our method significantly outperforms state-of-the-art approaches in terms of accuracy and robustness.
问问这篇 Paper
问问你的智能体。
Lune 读过与它相关的顶会 Paper,每个回答都会注明依据哪几篇。
相关 Paper
- Language-Driven Cross-Modal Classifier for Zero-Shot Multi-Label Image RecognitionYicheng Liu, Jie Wen, Chengliang Liu, Xiaozhao Fang 等ICML 2024 · 被引用 7 次
- Recognizing Unseen Objects via Multimodal Intensive Knowledge Graph PropagationLikang Wu, Zhi Li, Hongke Zhao, Zhefeng Wang 等KDD 2023 · 被引用 4 次
- Synergizing Multimodal Temporal Knowledge Graphs and Large Language Models for Social Relation RecognitionHaorui Wang, Zheng Wang, Yuxuan Zhang, Bo Wang 等EMNLP 2025 · 被引用 1 次
- HFR-MKGC: Hierarchical Fusion Reasoning with MLLMs for Multi-modal Knowledge Graph CompletionDi Wang, Junping Du, Zhe Xue, Meiyu Liang 等AAAI 2026
- Unleashing the Potential of Multimodal LLMs for Zero-Shot Spatio-Temporal Video GroundingZaiquan Yang, Yuhao Liu, Gerhard P. Hancke, Rynson W. H. LauNeurIPS 2025 · 被引用 10 次
