Learning Decomposed Spatial Relations for Multi-Variate Time-Series Modeling
Yuchen Fang, Kan Ren, Caihua Shan, Yifei Shen, You Li, Weinan Zhang, Yong Yu, Dongsheng Li
Abstract
Modeling multi-variate time-series (MVTS) data is a long-standing research subject and has found wide applications. Recently, there is a surge of interest in modeling spatial relations between variables as graphs, i.e., first learning one static graph for each dataset and then exploiting the graph structure via graph neural networks. However, as spatial relations may differ substantially across samples, building one static graph for all the samples inherently limits flexibility and severely degrades the performance in practice. To address this issue, we propose a framework for fine-grained modeling and utilization of spatial correlation between variables. By analyzing the statistical properties of real-world datasets, a universal decomposition of spatial correlation graphs is first identified. Specifically, the hidden spatial relations can be decomposed into a prior part, which applies across all the samples, and a dynamic part, which varies between samples, and building different graphs is necessary to model these relations. To better coordinate the learning of the two relational graphs, we propose a min-max learning paradigm that not only regulates the common part of different dynamic graphs but also guarantees spatial distinguishability among samples. The experimental results show that our proposed model outperforms the state-of-the-art baseline methods on both time-series forecasting and time-series point prediction tasks.
Ask about this paper
Your agent reads all of it.
Lune indexed this paper to the last equation, along with the top-tier papers that cite it. Ask a question and the answer quotes them.
Your agent calls
Luneget_paper_fulltext
Free to start. No credit card required.
Terminal
Install the CLIlune papers fulltext 2af83b15-0576-409b-ba4b-c636705f6b95Cited by top-tier papers3
- ContiFormer: Continuous-Time Transformer for Irregular Time Series ModelingYuqi Chen, Kan Ren, Yansen Wang, Yuchen Fang et al.NeurIPS 2023 · 131 citations
- Efficient and Effective Time-Series Forecasting with Spiking Neural NetworksChangze Lv, Yansen Wang, Dongqi Han, Xiaoqing Zheng et al.ICML 2024 · 29 citations
- From Chaos to Clarity: Time Series Anomaly Detection in Astronomical ObservationsXinli Hao, Yile Chen, Chen Yang, Zhihui Du et al.ICDE 2024 · 13 citations
Builds on11
- Autoformer: Decomposition Transformers with Auto-Correlation for Long-Term Series ForecastingHaixu Wu, Jiehui Xu, Jianmin Wang, Mingsheng LongNeurIPS 2021 · 5,824 citations
- Connecting the Dots: Multivariate Time Series Forecasting with Graph Neural NetworksZonghan Wu, Shirui Pan, Guodong Long, Jing Jiang et al.KDD 2020 · 1,738 citations
- Rethinking Graph Transformers with Spectral AttentionDevin Kreuzer, Dominique Beaini, William L. Hamilton, Vincent Létourneau et al.NeurIPS 2021 · 854 citations
- Spectral Temporal Graph Neural Network for Multivariate Time-series ForecastingDefu Cao, Yujing Wang, Juanyong Duan, Ce Zhang et al.NeurIPS 2020 · 841 citations
- Graph Structure Learning for Robust Graph Neural NetworksWei Jin, Yao Ma, Xiaorui Liu, Xianfeng Tang et al.KDD 2020 · 604 citations
Related papers
- METRO: A Generic Graph Neural Network Framework for Multivariate Time Series ForecastingYue Cui, Kai Zheng, Dingshan Cui, Jiandong Xie et al.VLDB 2022 · 75 citations
- Fully-Connected Spatial-Temporal Graph for Multivariate Time-Series DataYucheng Wang, Yuecong Xu, Jianfei Yang, Min Wu et al.AAAI 2024 · 127 citations
- Multiple Time Series Forecasting with Dynamic Graph ModelingKai Zhao, Chenjuan Guo, Yunyao Cheng, Peng Han et al.VLDB 2024 · 67 citations
- Pre-training Enhanced Spatial-temporal Graph Neural Network for Multivariate Time Series ForecastingZezhi Shao, Zhao Zhang, Fei Wang, Yongjun XuKDD 2022 · 260 citations
- FourierGNN: Rethinking Multivariate Time Series Forecasting from a Pure Graph PerspectiveKun Yi, Qi Zhang, Wei Fan, Hui He et al.NeurIPS 2023 · 359 citations
