Are Global Dependencies Necessary? Scalable Time Series Forecasting via Local Cross-Variate Modeling
Kun Liu, Renjun Jia, Ruifeng Yang, Xirui Zeng, Yuqi Liang, Cen Chen
摘要
Effectively modeling cross-variate dependencies is a central, yet challenging, task in multivariate time series forecasting. While attention-based methods have advanced the state-of-the-art by capturing global cross-variate dependencies, their quadratic complexity with respect to the number of variates severely limits their scalability. In this work, we challenge the necessity of global dependency modeling. We posit, through both theoretical analysis and empirical evidence, that modeling local cross-variate interactions is not only sufficient but also more efficient for many dense dependency systems. Motivated by this core insight, we propose VPNet, a novel architecture that excels in both accuracy and efficiency. VPNet's design is founded on two key principles: a channelized reinterpretation of patch embeddings into a higher-level variate-patch field, and a specialized VarTCNBlock that operates upon it. Specifically, the model first employs a patch-level autoencoder to extract robust local representations. In a pivotal step, these representations are then re-conceptualized as a 2D field constructed over a "variates × patches" grid. The VarTCNBlock then applies depthwise 2D convolutions across this field to efficiently capture local spatio-temporal patterns (i.e., cross-variate and temporal dependencies simultaneously), followed by pointwise convolutions for feature mixing. This design ensures that the computational complexity scales linearly with the number of variates. Finally, variate-wise prediction heads map the refined historical patch representations to future ones, which are decoded back into the time domain. Extensive experiments demonstrate that VPNet not only achieves state-of-the-art performance across multiple benchmarks but also offers significant efficiency gains, establishing it as a superior and scalable solution for high-dimensional forecasting.
问问这篇 Paper
智能体会读完全文。
Lune 把这篇 Paper 索引到了每一个公式,引用它的顶会 Paper 也一样。你提问,回答直接引用原文。
它引用的顶会 Paper8
- Autoformer: Decomposition Transformers with Auto-Correlation for Long-Term Series ForecastingHaixu Wu, Jiehui Xu, Jianmin Wang, Mingsheng LongNeurIPS 2021 · 被引用 5,824 次
- iTransformer: Inverted Transformers Are Effective for Time Series ForecastingYong Liu, Tengge Hu, Haoran Zhang, Haixu Wu 等ICLR 2024 · 被引用 1,703 次
- SCINet: Time Series Modeling and Forecasting with Sample Convolution and InteractionMinhao Liu, Ailing Zeng, Muxi Chen, Zhijian Xu 等NeurIPS 2022 · 被引用 934 次
- A Time Series is Worth 64 Words: Long-term Forecasting with TransformersYuqi Nie, Nam H. Nguyen, Phanwadee Sinthong, Jayant KalagnanamICLR 2023 · 被引用 536 次
- TimesNet: Temporal 2D-Variation Modeling for General Time Series AnalysisHaixu Wu, Tengge Hu, Yong Liu, Hang Zhou 等ICLR 2023 · 被引用 423 次
相关 Paper
- Temporal Query Network for Efficient Multivariate Time Series ForecastingShengsheng Lin, Haojun Chen, Haijie Wu, Chunyun Qiu 等ICML 2025
- FACT: Fine-grained Across-variable Convolution for Multivariate Time Series ForecastingHuiqiang Wang, Jieming Shi, Qing LiICLR 2026
- CCD: Capturing Cross-Correlations with Deformable Convolutional Networks for Multivariate Time Series ForecastingHanyin Cheng, Xingjian Wu, Xiangfei Qiu, Yang Shu 等KDD 2026 · 被引用 5 次
- Hi-Patch: Hierarchical Patch GNN for Irregular Multivariate Time SeriesYicheng Luo, Bowen Zhang, Zhen Liu, Qianli MaICML 2025
- Temporal Latent Auto-Encoder: A Method for Probabilistic Multivariate Time Series ForecastingNam Nguyen, Brian QuanzAAAI 2021 · 被引用 87 次
