Enhancing Large Language Models for Mobility Analytics with Semantic Location Tokenization
Yile Chen, Yicheng Tao, Yue Jiang, Shuai Liu, Han Yu, Gao Cong
Abstract
The widespread adoption of location-based services has led to the generation of vast amounts of mobility data, providing significant opportunities to model user movement dynamics within urban environments. Recent advancements have focused on adapting Large Language Models (LLMs) for mobility analytics. However, existing methods face two primary limitations: inadequate semantic representation of locations (i.e., discrete IDs) and insufficient modeling of mobility signals within LLMs (i.e., single templated instruction fine-tuning). To address these issues, we propose QT-Mob, a novel framework that significantly enhances LLMs for mobility analytics. QT-Mob introduces a location tokenization module that learns compact, semantically rich tokens to represent locations, preserving contextual information while ensuring compatibility with LLMs. Furthermore, QT-Mob incorporates a series of complementary fine-tuning objectives that align the learned tokens with the internal representations in LLMs, improving the model's comprehension of sequential movement patterns and location semantics. The proposed QT-Mob framework not only enhances LLMs' ability to interpret mobility data but also provides a more generalizable approach for various mobility analytics tasks. Experiments on three real-world dataset demonstrate the superior performance in both next-location prediction and mobility recovery tasks, outperforming existing deep learning and LLM-based methods.
Ask about this paper
Your agent reads all of it.
Lune indexed this paper to the last equation, along with the top-tier papers that cite it. Ask a question and the answer quotes them.
Your agent calls
Luneget_paper_fulltext
Free to start. No credit card required.
Terminal
Install the CLIlune papers fulltext 56a6a2fe-ebb9-4698-96ff-808e1c31087fBuilds on22
- LoRA: Low-Rank Adaptation of Large Language ModelsEdward J. Hu, Yelong Shen, Phillip Wallis, Zeyuan Allen-Zhu et al.ICLR 2022 · 18,833 citations
- Time-LLM: Time Series Forecasting by Reprogramming Large Language ModelsMing Jin, Shiyu Wang, Lintao Ma, Zhixuan Chu et al.ICLR 2024 · 915 citations
- STAN: Spatio-Temporal Attention Network for Next Location RecommendationYingtao Luo, Qiang Liu, Zhaocheng LiuWWW 2021 · 438 citations
- Where to Go Next: Modeling Long- and Short-Term User Preferences for Point-of-Interest RecommendationKe Sun, Tieyun Qian, Tong Chen, Yile Liang et al.AAAI 2020 · 412 citations
- TravelPlanner: A Benchmark for Real-World Planning with Language AgentsJian Xie, Kai Zhang, Jiangjie Chen, Tinghui Zhu et al.ICML 2024 · 376 citations
Related papers
- SILO: Semantic Integration for Location Prediction with Large Language ModelsTianao Sun, Meng Chen, Bowen Zhang, Genan Dai et al.KDD 2025
- Large Language Models as Urban Residents: An LLM Agent Framework for Personal Mobility GenerationJiawei Wang, Renhe Jiang, Chuang Yang, Zengqing Wu et al.NeurIPS 2024 · 181 citations
- Mobility-LLM: Learning Visiting Intentions and Travel Preference from Human Mobility Data with Large Language ModelsLetian Gong, Yan Lin, Xinyue Zhang, Yiwen Lu et al.NeurIPS 2024 · 59 citations
- Geography-Aware Large Language Models for Next POI RecommendationWei Liu, Zhao Liu, Muzu Xie, Huaijie Zhu et al.ICDE 2026 · 8 citations
- TrajLM: Transferable Mobility Pattern Distillation for Unified Trajectory Learning in Sparse Road NetworksXiaolin Han, Jianqiang Gao, Yuting Cui, Chenhao Ma et al.UbiComp 2026
