SILO: Semantic Integration for Location Prediction with Large Language Models
Tianao Sun, Meng Chen, Bowen Zhang, Genan Dai, Weiming Huang, Kai Zhao
Abstract
Next location prediction is a critical task in human mobility modeling, with broad applications in personalized recommendation, urban planning, and location-based services. Recently, researchers have used prompt-based large language models (LLMs) to improve next location prediction with pre-trained knowledge. However, they face inherent challenges in bridging the gap between textual prompts for semantic contextual understanding and human mobility data for transition pattern modeling. In this paper, we introduce SILO, a framework designed for Semantic Integration in LOcation prediction via LLMs. We first construct a hybrid semantic space that seamlessly integrates ID-based embeddings, text-derived semantics, and auxiliary contextual information, enabling comprehensive modeling of sequential mobility patterns alongside contextual nuances. We then propose user-centric prompts that specify the prediction task for LLMs while embedding user context within a special token. Further, we utilize LLMs as the prediction backbone to process both user-specific prompts and hybrid ID-context embeddings of location sequences. To enhance predictive performance, we finally introduce a dual-logits strategy, combining sequential transition logits with user profile-guided semantic preference logits. Extensive experiments on two large-scale real-world mobility datasets demonstrate that SILO significantly outperforms state-of-the-art baselines, validating its effectiveness in modeling complex mobility patterns through semantic integration using LLMs.
Ask about this paper
Your agent reads all of it.
Lune indexed this paper to the last equation, along with the top-tier papers that cite it. Ask a question and the answer quotes them.
Builds on13
- LoRA: Low-Rank Adaptation of Large Language ModelsEdward J. Hu, Yelong Shen, Phillip Wallis, Zeyuan Allen-Zhu et al.ICLR 2022 · 18,833 citations
- Where to Go Next: Modeling Long- and Short-Term User Preferences for Point-of-Interest RecommendationKe Sun, Tieyun Qian, Tong Chen, Yile Liang et al.AAAI 2020 · 412 citations
- GETNext: Trajectory Flow Map Enhanced Transformer for Next POI RecommendationSong Yang, Jiamou Liu, Kaiqi ZhaoSIGIR 2022 · 278 citations
- Pre-training Context and Time Aware Location Embeddings from Spatial-Temporal Trajectories for User Next Location PredictionYan Lin, Huaiyu Wan, Shengnan Guo, Youfang LinAAAI 2021 · 143 citations
- LLaRA: Large Language-Recommendation AssistantJiayi Liao, Sihang Li, Zhengyi Yang, Jiancan Wu et al.SIGIR 2024 · 120 citations
Related papers
- Geography-Aware Large Language Models for Next POI RecommendationWei Liu, Zhao Liu, Muzu Xie, Huaijie Zhu et al.ICDE 2026 · 8 citations
- Enhancing Large Language Models for Mobility Analytics with Semantic Location TokenizationYile Chen, Yicheng Tao, Yue Jiang, Shuai Liu et al.KDD 2025 · 3 citations
- SeMob: Semantic Synthesis for Dynamic Urban Mobility PredictionRunfei Chen, Shuyang Jiang, Wei HuangEMNLP 2025
- Reasoning Over Space: Enabling Geographic Reasoning for LLM-Based Generative Next POI RecommendationDongyi Lv, Qiuyu Ding, Heng-Da Xu, Zhaoxu Sun et al.ACL 2026 · 1 citation
- G²PRO: Gradient-guided Graph Prompt Optimization for LLM-based POI RecommendationNan Jiang, Haitao Yuan, Tianjun Wei, Yingpeng Du et al.KDD 2026
