Exploiting Pre-trained Language Model for Cross-city Urban Flow Prediction Guided by Information-theoretic Analysis
Qiang Zhou, Xudong Tong, Yuting Liu, Chuanxing Liu, Jingjing Gu
Abstract
Cross-city urban flow prediction is critical for democratizing smart application benefits in data-scarce developing cities. However, existing methods face an inherent performance ceiling, constrained by both the inevitably finite samples from the source city and the distributional gap between cities. In this paper, we present PLM-CUP, the first theoretically-grounded framework that breaks this bottleneck by leveraging a pre-trained language model (PLM) as an additional source domain. Through an information-theoretic analysis of the generalization error bound, we reveal that the key challenge lies in constructing a semantic bridge encoder and a task-specific adapter to enable cross-domain alignment when incorporating a PLM. Accordingly, PLM-CUP adopts a three-stage architecture, including a semantic bridge encoder that transforms spatiotemporal flow patterns into languagealigned representations via trend-periodicity decomposition, a PLM fine-tuned for knowledge transfer, and a task adapter with spatiotemporal self-attention to conduct multi-step prediction. We further introduce GDAConv, a graph convolution module with dual activation functions that enhances spatial modeling throughout the framework. Experiments on real-world datasets demonstrate that PLM-CUP significantly outperforms state-of-the-art baselines, validating the effectiveness of the proposed PLM enhanced cross-city transfer paradigm for urban flow prediction.
Ask about this paper
Your agent reads all of it.
Lune indexed this paper to the last equation, along with the top-tier papers that cite it. Ask a question and the answer quotes them.
Builds on11
- Adaptive Graph Convolutional Recurrent Network for Traffic ForecastingLei Bai, Lina Yao, Can Li, Xianzhi Wang et al.NeurIPS 2020 · 2,206 citations
- CrossGNN: Confronting Noisy Multivariate Time Series Via Cross Interaction RefinementQihe Huang, Lei Shen, Ruixin Zhang, Shouhong Ding et al.NeurIPS 2023 · 162 citations
- Spatio-Temporal Pivotal Graph Neural Networks for Traffic Flow ForecastingWeiyang Kong, Ziyu Guo, Yubao LiuAAAI 2024 · 98 citations
- Spatio-Temporal Inception Graph Convolutional Networks for Skeleton-Based Action RecognitionZhen Huang, Xu Shen, Xinmei Tian, Houqiang Li et al.ACM MM 2020 · 80 citations
- Urban Region Embedding via Multi-View Contrastive PredictionZechen Li, Weiming Huang, Kai Zhao, Min Yang et al.AAAI 2024 · 44 citations
Related papers
- Spatio-Temporal Few-Shot Learning via Diffusive Neural Network GenerationYuan Yuan, Chenyang Shao, Jingtao Ding, Depeng Jin et al.ICLR 2024 · 34 citations
- CrossST: An Efficient Pre-Training Framework for Cross-District Pattern Generalization in Urban Spatio-Temporal ForecastingAoyu Liu, Yaying ZhangICDE 2025 · 3 citations
- UniLLM: A Unified Large Language Model for Multi?Modal Urban Dynamics PredictionYuhang Liu, Yingxue Zhang, Xin Zhang, Yanhua Li et al.KDD 2026
- UniST: A Prompt-Empowered Universal Model for Urban Spatio-Temporal PredictionYuan Yuan, Jingtao Ding, Jie Feng, Depeng Jin et al.KDD 2024 · 75 citations
- UrbanMind: Urban Dynamics Prediction with Multifaceted Spatial-Temporal Large Language ModelsYuhang Liu, Yingxue Zhang, Xin Zhang, Ling Tian et al.KDD 2025 · 3 citations
