How Different from the Past? Spatio-Temporal Time Series Forecasting with Self-Supervised Deviation Learning
Haotian Gao, Zheng Dong, Jiawei Yong, Shintaro Fukushima, Kenjiro Taura, Renhe Jiang
摘要
Spatio-temporal forecasting is essential for real-world applications such as traffic management and urban computing. Although recent methods have shown improved accuracy, they often fail to account for dynamic deviations between current inputs and historical patterns. These deviations contain critical signals that can significantly affect model performance. To fill this gap, we propose ST-SSDL, a Spatio-Temporal time series forecasting framework that incorporates a Self-Supervised Deviation Learning scheme to capture and utilize such deviations. ST-SSDL anchors each input to its historical average and discretizes the latent space using learnable prototypes that represent typical spatio-temporal patterns. Two auxiliary objectives are proposed to refine this structure: a contrastive loss that enhances inter-prototype discriminability and a deviation loss that regularizes the distance consistency between input representations and corresponding prototypes to quantify deviation. Optimized jointly with the forecasting objective, these components guide the model to organize its hidden space and improve generalization across diverse input conditions. Experiments on six benchmark datasets show that ST-SSDL consistently outperforms state-of-the-art baselines across multiple metrics. Visualizations further demonstrate its ability to adaptively respond to varying levels of deviation in complex spatio-temporal scenarios. Our code and datasets are available at https://github.com/Jimmy-7664/ST-SSDL .
问问这篇 Paper
智能体会读完全文。
Lune 把这篇 Paper 索引到了每一个公式,引用它的顶会 Paper 也一样。你提问,回答直接引用原文。
引用它的顶会 Paper4
- STReasoner: Empowering LLMs for Spatio-Temporal Reasoning in Time Series via Spatial-Aware Reinforcement LearningJuntong Ni, Shiyu Wang, Qi He, Ming Jin 等ACL 2026 · 被引用 8 次
- Nested Spatio-Temporal Time Series ForecastingYingHao Ai, Yukai Zhou, Ruoxi Jiang, Junyi An 等ICML 2026 · 被引用 1 次
- Meta Dynamic Graph for Traffic Flow PredictionYiqing Zou, Hanning Yuan, Qianyu Yang, Ziqiang Yuan 等AAAI 2026
- Channel Adapter for Time Series Foundation Models in Zero-Shot Multivariate ForecastingDongyuan Li, Renhe Jiang, Shun Zheng, Zheng Dong 等ICML 2026
它引用的顶会 Paper38
- A Simple Framework for Contrastive Learning of Visual RepresentationsTing Chen, Simon Kornblith, Mohammad Norouzi, Geoffrey E. HintonICML 2020 · 被引用 24,064 次
- wav2vec 2.0: A Framework for Self-Supervised Learning of Speech RepresentationsAlexei Baevski, Yuhao Zhou, Abdelrahman Mohamed, Michael AuliNeurIPS 2020 · 被引用 9,451 次
- Bootstrap Your Own Latent - A New Approach to Self-Supervised LearningJean-Bastien Grill, Florian Strub, Florent Altché, Corentin Tallec 等NeurIPS 2020 · 被引用 9,171 次
- Adaptive Graph Convolutional Recurrent Network for Traffic ForecastingLei Bai, Lina Yao, Can Li, Xianzhi Wang 等NeurIPS 2020 · 被引用 2,206 次
- Connecting the Dots: Multivariate Time Series Forecasting with Graph Neural NetworksZonghan Wu, Shirui Pan, Guodong Long, Jing Jiang 等KDD 2020 · 被引用 1,738 次
相关 Paper
- Spatio-Temporal Self-Supervised Learning for Traffic Flow PredictionJiahao Ji, Jingyuan Wang, Chao Huang, Junjie Wu 等AAAI 2023 · 被引用 287 次
- ST-ReP: Learning Predictive Representations Efficiently for Spatial-Temporal ForecastingQi Zheng, Zihao Yao, Yaying ZhangAAAI 2025 · 被引用 2 次
- SSL-STMFormer Self-Supervised Learning Spatio-Temporal Entanglement Transformer for Traffic Flow PredictionZetao Li, Zheng Hu, Peng Han, Yu Gu 等AAAI 2025 · 被引用 12 次
- CSTDFormer: Empowering Transformers to Learn Spatio-Temporal Delays via Contrastive LearningEn Wang, Jiajian Lv, Di Liang, Zidie Zhou 等INFOCOM 2026
- Towards Spatio- Temporal Aware Traffic Time Series ForecastingRazvan-Gabriel Cirstea, Bin Yang, Chenjuan Guo, Tung Kieu 等ICDE 2022 · 被引用 137 次
