How Different from the Past? Spatio-Temporal Time Series Forecasting with Self-Supervised Deviation Learning
Haotian Gao, Zheng Dong, Jiawei Yong, Shintaro Fukushima, Kenjiro Taura, Renhe Jiang
Abstract
Spatio-temporal forecasting is essential for real-world applications such as traffic management and urban computing. Although recent methods have shown improved accuracy, they often fail to account for dynamic deviations between current inputs and historical patterns. These deviations contain critical signals that can significantly affect model performance. To fill this gap, we propose ST-SSDL, a Spatio-Temporal time series forecasting framework that incorporates a Self-Supervised Deviation Learning scheme to capture and utilize such deviations. ST-SSDL anchors each input to its historical average and discretizes the latent space using learnable prototypes that represent typical spatio-temporal patterns. Two auxiliary objectives are proposed to refine this structure: a contrastive loss that enhances inter-prototype discriminability and a deviation loss that regularizes the distance consistency between input representations and corresponding prototypes to quantify deviation. Optimized jointly with the forecasting objective, these components guide the model to organize its hidden space and improve generalization across diverse input conditions. Experiments on six benchmark datasets show that ST-SSDL consistently outperforms state-of-the-art baselines across multiple metrics. Visualizations further demonstrate its ability to adaptively respond to varying levels of deviation in complex spatio-temporal scenarios. Our code and datasets are available at https://github.com/Jimmy-7664/ST-SSDL .
Ask about this paper
Your agent reads all of it.
Lune indexed this paper to the last equation, along with the top-tier papers that cite it. Ask a question and the answer quotes them.
Your agent calls
Luneget_paper_fulltext
Free to start. No credit card required.
Terminal
Install the CLIlune papers fulltext 79305a56-1514-4c09-affc-a9c3e0d1121eCited by top-tier papers4
- STReasoner: Empowering LLMs for Spatio-Temporal Reasoning in Time Series via Spatial-Aware Reinforcement LearningJuntong Ni, Shiyu Wang, Qi He, Ming Jin et al.ACL 2026 · 8 citations
- Nested Spatio-Temporal Time Series ForecastingYingHao Ai, Yukai Zhou, Ruoxi Jiang, Junyi An et al.ICML 2026 · 1 citation
- Meta Dynamic Graph for Traffic Flow PredictionYiqing Zou, Hanning Yuan, Qianyu Yang, Ziqiang Yuan et al.AAAI 2026
- Channel Adapter for Time Series Foundation Models in Zero-Shot Multivariate ForecastingDongyuan Li, Renhe Jiang, Shun Zheng, Zheng Dong et al.ICML 2026
Builds on38
- A Simple Framework for Contrastive Learning of Visual RepresentationsTing Chen, Simon Kornblith, Mohammad Norouzi, Geoffrey E. HintonICML 2020 · 24,064 citations
- wav2vec 2.0: A Framework for Self-Supervised Learning of Speech RepresentationsAlexei Baevski, Yuhao Zhou, Abdelrahman Mohamed, Michael AuliNeurIPS 2020 · 9,451 citations
- Bootstrap Your Own Latent - A New Approach to Self-Supervised LearningJean-Bastien Grill, Florian Strub, Florent Altché, Corentin Tallec et al.NeurIPS 2020 · 9,171 citations
- Adaptive Graph Convolutional Recurrent Network for Traffic ForecastingLei Bai, Lina Yao, Can Li, Xianzhi Wang et al.NeurIPS 2020 · 2,206 citations
- Connecting the Dots: Multivariate Time Series Forecasting with Graph Neural NetworksZonghan Wu, Shirui Pan, Guodong Long, Jing Jiang et al.KDD 2020 · 1,738 citations
Related papers
- Spatio-Temporal Self-Supervised Learning for Traffic Flow PredictionJiahao Ji, Jingyuan Wang, Chao Huang, Junjie Wu et al.AAAI 2023 · 287 citations
- ST-ReP: Learning Predictive Representations Efficiently for Spatial-Temporal ForecastingQi Zheng, Zihao Yao, Yaying ZhangAAAI 2025 · 2 citations
- SSL-STMFormer Self-Supervised Learning Spatio-Temporal Entanglement Transformer for Traffic Flow PredictionZetao Li, Zheng Hu, Peng Han, Yu Gu et al.AAAI 2025 · 12 citations
- CSTDFormer: Empowering Transformers to Learn Spatio-Temporal Delays via Contrastive LearningEn Wang, Jiajian Lv, Di Liang, Zidie Zhou et al.INFOCOM 2026
- Towards Spatio- Temporal Aware Traffic Time Series ForecastingRazvan-Gabriel Cirstea, Bin Yang, Chenjuan Guo, Tung Kieu et al.ICDE 2022 · 137 citations
