TransLLM: A Unified Multi-Task Large Language Model for Urban Transportation via Learnable Prompting
Jiaming Leng, Yunying Bi, Chuan Qin, Zhenya Huang, Bing Yin, Haojie Ren, Yanyong Zhang, Chao Wang
Abstract
Urban transportation systems require precise modeling of dynamic spatiotemporal patterns across diverse tasks, such as traffic forecasting, electric vehicle (EV) charging demand prediction, and taxi dispatch. Existing approaches suffer from two key limitations: traditional deep learning models are task-specific and lack generalization capabilities, whereas Large Language Models (LLMs) struggle with structured spatiotemporal data and numerical reasoning. To bridge this gap, we propose TransLLM, a unified multi-task framework that synergizes spatiotemporal encoding with LLM reasoning through learnable prompt composition. To enable LLMs to perceive complex graph dependencies, we design a noise-augmented spatiotemporal encoder that projects structured signals into the LLM's embedding space. Furthermore, to overcome the rigidity of fixed prompt templates in heterogeneous traffic scenarios, we introduce an instance-level prompt routing mechanism trained via reinforcement learning. The framework operates by encoding spatiotemporal patterns into contextual representations, dynamically composing personalized prompts to guide LLM reasoning, and projecting the resulting representations through specialized output layers to generate task-specific predictions. Experiments on seven datasets and three tasks demonstrate that TransLLM outperforms many baselines, showing superior adaptability in both supervised and zero-shot settings with excellent generalization and robustness. Our code and data are available at https: //github.com/lengjiaming/TransLLM .
Ask about this paper
Your agent reads all of it.
Lune indexed this paper to the last equation, along with the top-tier papers that cite it. Ask a question and the answer quotes them.
Your agent calls
Luneget_paper_fulltext
Free to start. No credit card required.
Terminal
Install the CLIlune papers fulltext 4bff9be2-8a7b-4e57-9cf9-3c691713e5baBuilds on7
- LoRA: Low-Rank Adaptation of Large Language ModelsEdward J. Hu, Yelong Shen, Phillip Wallis, Zeyuan Allen-Zhu et al.ICLR 2022 · 18,833 citations
- Faith and Fate: Limits of Transformers on CompositionalityNouha Dziri, Ximing Lu, Melanie Sclar, Xiang Lorraine Li et al.NeurIPS 2023 · 728 citations
- Spatial-Temporal Graph ODE Networks for Traffic Flow ForecastingZheng Fang, Qingqing Long, Guojie Song, Kunqing XieKDD 2021 · 555 citations
- Decoupled Dynamic Spatial-Temporal Graph Neural Network for Traffic ForecastingZezhi Shao, Zhao Zhang, Wei Wei, Fei Wang et al.VLDB 2022 · 353 citations
- Semi-Supervised Hierarchical Recurrent Graph Neural Network for City-Wide Parking Availability PredictionWeijia Zhang, Hao Liu, Yanchi Liu, Jingbo Zhou et al.AAAI 2020 · 111 citations
Related papers
- UrbanMind: Urban Dynamics Prediction with Multifaceted Spatial-Temporal Large Language ModelsYuhang Liu, Yingxue Zhang, Xin Zhang, Ling Tian et al.KDD 2025 · 3 citations
- Traj-MLLM: Can Multimodal Large Language Models Reform Trajectory Data Mining?Shuo Liu, Di Yao, Yan Lin, Gao Cong et al.KDD 2026 · 2 citations
- UniLLM: A Unified Large Language Model for Multi?Modal Urban Dynamics PredictionYuhang Liu, Yingxue Zhang, Xin Zhang, Yanhua Li et al.KDD 2026
- TrajLM: Transferable Mobility Pattern Distillation for Unified Trajectory Learning in Sparse Road NetworksXiaolin Han, Jianqiang Gao, Yuting Cui, Chenhao Ma et al.UbiComp 2026
- UniST: A Prompt-Empowered Universal Model for Urban Spatio-Temporal PredictionYuan Yuan, Jingtao Ding, Jie Feng, Depeng Jin et al.KDD 2024 · 75 citations
