KAMEL: A Scalable BERT-based System for Trajectory Imputation
Mashaal Musleh, Mohamed F. Mokbel
Abstract
Numerous important applications rely on detailed trajectory data. Yet, unfortunately, trajectory datasets are typically sparse with large spatial and temporal gaps between each two points, which is a major hurdle for their accuracy. This paper presents Kamel; a scalable trajectory imputation system that inserts additional realistic trajectory points, boosting the accuracy of trajectory applications. Kamel maps the trajectory imputation problem to finding the missing word problem; a classical problem in the natural language processing (NLP) community. This allows employing the widely used BERT model for trajectory imputation. However, BERT, as is, does not lend itself to the special characteristics of trajectories. Hence, Kamel starts from BERT, but then adds spatial-awareness to its operations, adjusts trajectory data to be closer to the nature of language data, and adds multipoint imputation ability to it; all encapsulated in one system. Experimental results based on real datasets show that Kamel significantly outperforms its competitors and is applicable to city-scale trajectories, large gaps, and tight accuracy thresholds.
Ask about this paper
Your agent reads all of it.
Lune indexed this paper to the last equation, along with the top-tier papers that cite it. Ask a question and the answer quotes them.
Cited by top-tier papers2
- MH-GIN: Multi-scale Heterogeneous Graph-based Imputation Network for AIS DataHengyu Liu, Tianyi Li, Yuqiang He, Kristian Torp et al.VLDB 2026 · 4 citations
- KAFY: An Extensible and Scalable Transformers-Based System for Trajectory Data AnalysisYoussef Hussein, Mohamed F. MokbelVLDB 2026
Builds on7
- Language Models are Few-Shot LearnersTom B. Brown, Benjamin Mann, Nick Ryder, Melanie Subbiah et al.NeurIPS 2020 · 64,255 citations
- ALBERT: A Lite BERT for Self-supervised Learning of Language RepresentationsZhenzhong Lan, Mingda Chen, Sebastian Goodman, Kevin Gimpel et al.ICLR 2020 · 7,418 citations
- Generative Semi-supervised Learning for Multivariate Time Series ImputationXiaoye Miao, Yangyang Wu, Jun Wang, Yunjun Gao et al.AAAI 2021 · 212 citations
- Filling the G_ap_s: Multivariate Time Series Imputation by Graph Neural NetworksAndrea Cini, Ivan Marisca, Cesare AlippiICLR 2022 · 179 citations
- Learning to Generate Maps from TrajectoriesSijie Ruan, Cheng Long, Jie Bao, Chunyang Li et al.AAAI 2020 · 85 citations
Related papers
- PLMTrajRec: A Scalable and Generalizable Trajectory Recovery Method with Pre-trained Language ModelsTonglong Wei, Yan Lin, Youfang Lin, Shengnan Guo et al.NeurIPS 2025 · 3 citations
- ProDiff: Prototype-Guided Diffusion for Minimal Information Trajectory ImputationTianci Bu, Le Zhou, Wenchuan Yang, Jianhong Mou et al.ICML 2025
- Efficient Methods for Accurate Sparse Trajectory Recovery and Map MatchingWei Tian, Jieming Shi, Man Lung YiuICDE 2025 · 5 citations
- From GPS Points to Travel Patterns: Flexible and Semantic Trajectory Generation with LLMsSilin Zhou, Chenhao Wang, Yuntao Wen, Shuo Shang et al.KDD 2026 · 2 citations
- Imitative Non-Autoregressive Modeling for Trajectory Forecasting and ImputationMengshi Qi, Jie Qin, Yu Wu, Yi YangCVPR 2020
