HN-MVTS: HyperNetwork-based Multivariate Time Series Forecasting
Andrey V. Savchenko, Oleg Kachan
摘要
Accurate forecasting of multivariate time series data remains a formidable challenge, particularly due to the growing complexity of temporal dependencies in real-world scenarios. While neural network-based models have achieved notable success in this domain, complex channel-dependent models often suffer from performance degradation compared to channel-independent models that do not consider the relationship between components but provide high robustness due to small capacity. In this work, we propose HN-MVTS, a novel architecture that integrates the hypernetwork-based generative prior with an arbitrary neural network forecasting model. The input of this hypernetwork is a learnable embedding matrix of time series components. To restrict the number of new parameters, the hypernetwork learns to generate the weights of the last layer of the target forecasting networks, serving as a data-adaptive regularizer that improves generalization and long-range predictive accuracy. The hypernetwork is only used during training, so it does not increase the inference time compared to the base forecasting model. Extensive experiments on eight benchmark datasets demonstrate that application of HN-MVTS to the state-of-the-art models (DLinear, PatchTST, TSMixer, etc.) typically improves their performance. Our findings suggest that hypernetwork-driven parameterization offers a promising direction for enhancing existing forecasting techniques in complex scenarios.
问问这篇 Paper
智能体会读完全文。
Lune 把这篇 Paper 索引到了每一个公式,引用它的顶会 Paper 也一样。你提问,回答直接引用原文。
它引用的顶会 Paper14
- Informer: Beyond Efficient Transformer for Long Sequence Time-Series ForecastingHaoyi Zhou, Shanghang Zhang, Jieqi Peng, Shuai Zhang 等AAAI 2021 · 被引用 7,289 次
- Are Transformers Effective for Time Series Forecasting?Ailing Zeng, Muxi Chen, Lei Zhang, Qiang XuAAAI 2023 · 被引用 3,619 次
- FEDformer: Frequency Enhanced Decomposed Transformer for Long-term Series ForecastingTian Zhou, Ziqing Ma, Qingsong Wen, Xue Wang 等ICML 2022 · 被引用 2,912 次
- Reversible Instance Normalization for Accurate Time-Series Forecasting against Distribution ShiftTaesung Kim, Jinhee Kim, Yunwon Tae, Cheonbok Park 等ICLR 2022 · 被引用 1,020 次
- TimeMixer: Decomposable Multiscale Mixing for Time Series ForecastingShiyu Wang, Haixu Wu, Xiaoming Shi, Tengge Hu 等ICLR 2024 · 被引用 573 次
相关 Paper
- HyperIMTS: Hypergraph Neural Network for Irregular Multivariate Time Series ForecastingBoyuan Li, Yicheng Luo, Zhen Liu, Junhao Zheng 等ICML 2025
- HyperMixer: Specializable Hypergraph Channel Mixing for Long-term Multivariate Time Series ForecastingChangyuan Tian, Zhicong Lu, Zequn Zhang, Heming Yang 等AAAI 2025 · 被引用 5 次
- Considering Nonstationary within Multivariate Time Series with Variational Hierarchical Transformer for ForecastingMuyao Wang, Wenchao Chen, Bo ChenAAAI 2024 · 被引用 13 次
- A Time Series is Worth 64 Words: Long-term Forecasting with TransformersYuqi Nie, Nam H. Nguyen, Phanwadee Sinthong, Jayant KalagnanamICLR 2023 · 被引用 536 次
- Generative Pretrained Hierarchical Transformer for Time Series ForecastingZhiding Liu, Jiqian Yang, Mingyue Cheng, Yucong Luo 等KDD 2024 · 被引用 29 次
