Exploiting Pre-trained Language Model for Cross-city Urban Flow Prediction Guided by Information-theoretic Analysis
Qiang Zhou, Xudong Tong, Yuting Liu, Chuanxing Liu, Jingjing Gu
摘要
Cross-city urban flow prediction is critical for democratizing smart application benefits in data-scarce developing cities. However, existing methods face an inherent performance ceiling, constrained by both the inevitably finite samples from the source city and the distributional gap between cities. In this paper, we present PLM-CUP, the first theoretically-grounded framework that breaks this bottleneck by leveraging a pre-trained language model (PLM) as an additional source domain. Through an information-theoretic analysis of the generalization error bound, we reveal that the key challenge lies in constructing a semantic bridge encoder and a task-specific adapter to enable cross-domain alignment when incorporating a PLM. Accordingly, PLM-CUP adopts a three-stage architecture, including a semantic bridge encoder that transforms spatiotemporal flow patterns into languagealigned representations via trend-periodicity decomposition, a PLM fine-tuned for knowledge transfer, and a task adapter with spatiotemporal self-attention to conduct multi-step prediction. We further introduce GDAConv, a graph convolution module with dual activation functions that enhances spatial modeling throughout the framework. Experiments on real-world datasets demonstrate that PLM-CUP significantly outperforms state-of-the-art baselines, validating the effectiveness of the proposed PLM enhanced cross-city transfer paradigm for urban flow prediction.
问问这篇 Paper
智能体会读完全文。
Lune 把这篇 Paper 索引到了每一个公式,引用它的顶会 Paper 也一样。你提问,回答直接引用原文。
它引用的顶会 Paper11
- Adaptive Graph Convolutional Recurrent Network for Traffic ForecastingLei Bai, Lina Yao, Can Li, Xianzhi Wang 等NeurIPS 2020 · 被引用 2,206 次
- CrossGNN: Confronting Noisy Multivariate Time Series Via Cross Interaction RefinementQihe Huang, Lei Shen, Ruixin Zhang, Shouhong Ding 等NeurIPS 2023 · 被引用 162 次
- Spatio-Temporal Pivotal Graph Neural Networks for Traffic Flow ForecastingWeiyang Kong, Ziyu Guo, Yubao LiuAAAI 2024 · 被引用 98 次
- Spatio-Temporal Inception Graph Convolutional Networks for Skeleton-Based Action RecognitionZhen Huang, Xu Shen, Xinmei Tian, Houqiang Li 等ACM MM 2020 · 被引用 80 次
- Urban Region Embedding via Multi-View Contrastive PredictionZechen Li, Weiming Huang, Kai Zhao, Min Yang 等AAAI 2024 · 被引用 44 次
相关 Paper
- Spatio-Temporal Few-Shot Learning via Diffusive Neural Network GenerationYuan Yuan, Chenyang Shao, Jingtao Ding, Depeng Jin 等ICLR 2024 · 被引用 34 次
- CrossST: An Efficient Pre-Training Framework for Cross-District Pattern Generalization in Urban Spatio-Temporal ForecastingAoyu Liu, Yaying ZhangICDE 2025 · 被引用 3 次
- UniLLM: A Unified Large Language Model for Multi?Modal Urban Dynamics PredictionYuhang Liu, Yingxue Zhang, Xin Zhang, Yanhua Li 等KDD 2026
- UniST: A Prompt-Empowered Universal Model for Urban Spatio-Temporal PredictionYuan Yuan, Jingtao Ding, Jie Feng, Depeng Jin 等KDD 2024 · 被引用 75 次
- UrbanMind: Urban Dynamics Prediction with Multifaceted Spatial-Temporal Large Language ModelsYuhang Liu, Yingxue Zhang, Xin Zhang, Ling Tian 等KDD 2025 · 被引用 3 次
