GeoKGM: A Multimodal Large Language Model for Zero-Shot Knowledge Graph Completion in Geospatial Databases
Zhihan Zheng, Haitao Yuan, Minxiao Chen, Nan Jiang, Haoning Wang, Shangguang Wang
Abstract
Geospatial Knowledge Graphs (KGs) are widely used data structures that integrate rich knowledge from multi-source databases and play a crucial role in applications such as data retrieval and urban management. However, existing methods for Geospatial Knowledge Graph Completion (KGC) heavily rely on extensive labeled data and lack the ability to direct inference on new unlabeled geospatial databases and thus limiting their practical deployment. To address this limitation, this paper first formalizes a novel zero-shot transfer scenario and then proposes an innovative geospatial multimodal large language model framework capable of efficient Geospatial KGC with robust zero-shot generalization capabilities. Specifically, to enable effective direct inference under significant data discrepancies inherent in zero-shot scenarios, we introduce large language models (LLMs) into the geospatial KGC problem for the first time and redefine the multimodal data processing paradigm for geospatial LLMs. Next, to overcome the challenge that LLMs cannot directly handle geospatial data, we innovatively propose a Pretrain Geospatial Encoder that performs self-supervised pretraining exclusively on spatial data. Additionally, to integrate geospatial and textual modalities, we design an adaptation component that injects geospatial features into the LLMs and introduce a multi-task fine-tuning procedure. Lastly, to ensure robustness across multi-target domain scenarios, we present an implicit data alignment strategy based on adversarial learning. Extensive evaluations conducted on four real-world datasets demonstrate that our method significantly outperforms state-of-the-art approaches in terms of accuracy and robustness.
Ask about this paper
Ask your agent about it.
Lune has read the top-tier papers around this one, so every answer names the papers it rests on.
Your agent calls
Lunesearch_papers
Free to start. No credit card required.
Terminal
Install the CLIlune papers get 66ebb24e-e25d-4791-b91c-580de21f63a7Related papers
- Language-Driven Cross-Modal Classifier for Zero-Shot Multi-Label Image RecognitionYicheng Liu, Jie Wen, Chengliang Liu, Xiaozhao Fang et al.ICML 2024 · 7 citations
- Recognizing Unseen Objects via Multimodal Intensive Knowledge Graph PropagationLikang Wu, Zhi Li, Hongke Zhao, Zhefeng Wang et al.KDD 2023 · 4 citations
- Synergizing Multimodal Temporal Knowledge Graphs and Large Language Models for Social Relation RecognitionHaorui Wang, Zheng Wang, Yuxuan Zhang, Bo Wang et al.EMNLP 2025 · 1 citation
- HFR-MKGC: Hierarchical Fusion Reasoning with MLLMs for Multi-modal Knowledge Graph CompletionDi Wang, Junping Du, Zhe Xue, Meiyu Liang et al.AAAI 2026
- Unleashing the Potential of Multimodal LLMs for Zero-Shot Spatio-Temporal Video GroundingZaiquan Yang, Yuhao Liu, Gerhard P. Hancke, Rynson W. H. LauNeurIPS 2025 · 10 citations
