SILO: Semantic Integration for Location Prediction with Large Language Models
Tianao Sun, Meng Chen, Bowen Zhang, Genan Dai, Weiming Huang, Kai Zhao
摘要
Next location prediction is a critical task in human mobility modeling, with broad applications in personalized recommendation, urban planning, and location-based services. Recently, researchers have used prompt-based large language models (LLMs) to improve next location prediction with pre-trained knowledge. However, they face inherent challenges in bridging the gap between textual prompts for semantic contextual understanding and human mobility data for transition pattern modeling. In this paper, we introduce SILO, a framework designed for Semantic Integration in LOcation prediction via LLMs. We first construct a hybrid semantic space that seamlessly integrates ID-based embeddings, text-derived semantics, and auxiliary contextual information, enabling comprehensive modeling of sequential mobility patterns alongside contextual nuances. We then propose user-centric prompts that specify the prediction task for LLMs while embedding user context within a special token. Further, we utilize LLMs as the prediction backbone to process both user-specific prompts and hybrid ID-context embeddings of location sequences. To enhance predictive performance, we finally introduce a dual-logits strategy, combining sequential transition logits with user profile-guided semantic preference logits. Extensive experiments on two large-scale real-world mobility datasets demonstrate that SILO significantly outperforms state-of-the-art baselines, validating its effectiveness in modeling complex mobility patterns through semantic integration using LLMs.
问问这篇 Paper
智能体会读完全文。
Lune 把这篇 Paper 索引到了每一个公式,引用它的顶会 Paper 也一样。你提问,回答直接引用原文。
它引用的顶会 Paper13
- LoRA: Low-Rank Adaptation of Large Language ModelsEdward J. Hu, Yelong Shen, Phillip Wallis, Zeyuan Allen-Zhu 等ICLR 2022 · 被引用 18,833 次
- Where to Go Next: Modeling Long- and Short-Term User Preferences for Point-of-Interest RecommendationKe Sun, Tieyun Qian, Tong Chen, Yile Liang 等AAAI 2020 · 被引用 412 次
- GETNext: Trajectory Flow Map Enhanced Transformer for Next POI RecommendationSong Yang, Jiamou Liu, Kaiqi ZhaoSIGIR 2022 · 被引用 278 次
- Pre-training Context and Time Aware Location Embeddings from Spatial-Temporal Trajectories for User Next Location PredictionYan Lin, Huaiyu Wan, Shengnan Guo, Youfang LinAAAI 2021 · 被引用 143 次
- LLaRA: Large Language-Recommendation AssistantJiayi Liao, Sihang Li, Zhengyi Yang, Jiancan Wu 等SIGIR 2024 · 被引用 120 次
相关 Paper
- Geography-Aware Large Language Models for Next POI RecommendationWei Liu, Zhao Liu, Muzu Xie, Huaijie Zhu 等ICDE 2026 · 被引用 8 次
- Enhancing Large Language Models for Mobility Analytics with Semantic Location TokenizationYile Chen, Yicheng Tao, Yue Jiang, Shuai Liu 等KDD 2025 · 被引用 3 次
- SeMob: Semantic Synthesis for Dynamic Urban Mobility PredictionRunfei Chen, Shuyang Jiang, Wei HuangEMNLP 2025
- Reasoning Over Space: Enabling Geographic Reasoning for LLM-Based Generative Next POI RecommendationDongyi Lv, Qiuyu Ding, Heng-Da Xu, Zhaoxu Sun 等ACL 2026 · 被引用 1 次
- G²PRO: Gradient-guided Graph Prompt Optimization for LLM-based POI RecommendationNan Jiang, Haitao Yuan, Tianjun Wei, Yingpeng Du 等KDD 2026
