Being More Lightweight and Practical: Mini-sized Contrastive Learning Pre-trained Models for Fine-grained Traffic Task
Shuhao Li, Weidong Yang, Ben Fei, Yue Cui, Lipeng Ma, Fan Zhang
Abstract
Fine-grained traffic prediction is critically important for mitigating traffic congestion in key urban areas and for providing lane-change guidance in autonomous vehicles and navigation systems. However, task-specific models are not efficient enough, city-scale pre-trained models often overlook fine-grained requirements, and the demand for extensive computational resources hinders practical deployment. To address this issue, we developed a lightweight pre-training framework, MiniTraffic. This framework leverages abundant road-level data to address lane-level data scarcity through a frequency domain stability augmentation module and captures road-lane correlations via contrastive clustering to construct small-scale graph structures, significantly reducing model parameters. Fine-tuning with minimal target data provides a unified and efficient solution for fine-grained traffic prediction. In multi-granularity traffic prediction tasks across six fine-grained datasets, MiniTraffic demonstrated superior performance compared to existing baselines.
Ask about this paper
Your agent reads all of it.
Lune indexed this paper to the last equation, along with the top-tier papers that cite it. Ask a question and the answer quotes them.
Your agent calls
Luneget_paper_fulltext
Free to start. No credit card required.
Terminal
Install the CLIlune papers fulltext 572efde7-0063-4d8d-a86b-2a554a783b7eBuilds on17
- Adaptive Graph Convolutional Recurrent Network for Traffic ForecastingLei Bai, Lina Yao, Can Li, Xianzhi Wang et al.NeurIPS 2020 · 2,206 citations
- Connecting the Dots: Multivariate Time Series Forecasting with Graph Neural NetworksZonghan Wu, Shirui Pan, Guodong Long, Jing Jiang et al.KDD 2020 · 1,738 citations
- iTransformer: Inverted Transformers Are Effective for Time Series ForecastingYong Liu, Tengge Hu, Haoran Zhang, Haixu Wu et al.ICLR 2024 · 1,703 citations
- Spatial-Temporal Synchronous Graph Convolutional Networks: A New Framework for Spatial-Temporal Network Data ForecastingChao Song, Youfang Lin, Shengnan Guo, Huaiyu WanAAAI 2020 · 1,659 citations
- Reversible Instance Normalization for Accurate Time-Series Forecasting against Distribution ShiftTaesung Kim, Jinhee Kim, Yunwon Tae, Cheonbok Park et al.ICLR 2022 · 1,020 citations
Related papers
- Fine-Grained Traffic Inference from Road to Lane via Spatio-Temporal Graph Node GenerationShuhao Li, Weidong Yang, Yue Cui, Xiaoxing Liu et al.KDD 2025 · 1 citation
- ST-ABC: Spatio-Temporal Attention-Based Convolutional Network for Multi-Scale Lane-Level Traffic PredictionShuhao Li, Yue Cui, Libin Li, Weidong Yang et al.ICDE 2024 · 13 citations
- ROI-demand Traffic Prediction: A Pre-train, Query and Fine-tune FrameworkYue Cui, Shuhao Li, Wenjin Deng, Zhaokun Zhang et al.ICDE 2023 · 10 citations
- Selective Cross-City Transfer Learning for Traffic Prediction via Source City Region Re-WeightingYilun Jin, Kai Chen, Qiang YangKDD 2022 · 76 citations
- TrafficFormer: An Efficient Pre-trained Model for Traffic DataGuangmeng Zhou, Xiongwen Guo, Zhuotao Liu, Tong Li et al.S&P 2025
