Structured Matrix Basis for Multivariate Time Series Forecasting with Interpretable Dynamics
Xiaodan Chen, Xiucheng Li, Xinyang Chen, Zhijun Li
Abstract
Multivariate time series forecasting is of central importance in modern intelligent decision systems. The dynamics of multivariate time series are jointly characterized by temporal dependencies and spatial correlations. Hence, it is equally important to build the forecasting models from both perspectives. The real-world multivariate time series data often presents spatial correlations that show structures and evolve dynamically. To capture such dynamic spatial structures, the existing forecasting approaches often rely on a two-stage learning process (learning dynamic series representations and then generating spatial structures), which is sensitive to the small time-window input data and has high variance. To address this, we propose a novel forecasting model with a structured matrix basis. At its core is a dynamic spatial structure generation function whose output space is well-constrained and the generated structures have lower variance, meanwhile, it is more expressive and can offer interpretable dynamics. This is achieved via a novel structured parameterization and imposing structure regularization on the matrix basis. The resulting forecasting model can achieve up to 8 . 5% improvements over the existing methods on six benchmark datasets, and meanwhile, it enables us to gain insights into the dynamics of underlying systems.
Ask about this paper
Your agent reads all of it.
Lune indexed this paper to the last equation, along with the top-tier papers that cite it. Ask a question and the answer quotes them.
Your agent calls
Luneget_paper_fulltext
Free to start. No credit card required.
Terminal
Install the CLIlune papers fulltext 2fa960ea-76c7-40f4-883d-68538ba2a059Cited by top-tier papers2
- DIFFODE: Neural ODE with Differentiable Hidden State for Irregular Time Series AnalysisYudong Zhang, Xu Wang, Xuan Yu, Zhengyang Zhou et al.ICDE 2025 · 3 citations
- FSTLLM: Spatio-Temporal LLM for Few Shot Time Series ForecastingYue Jiang, Yile Chen, Xiucheng Li, Qin Chao et al.ICML 2025
Builds on26
- Informer: Beyond Efficient Transformer for Long Sequence Time-Series ForecastingHaoyi Zhou, Shanghang Zhang, Jieqi Peng, Shuai Zhang et al.AAAI 2021 · 7,289 citations
- Autoformer: Decomposition Transformers with Auto-Correlation for Long-Term Series ForecastingHaixu Wu, Jiehui Xu, Jianmin Wang, Mingsheng LongNeurIPS 2021 · 5,824 citations
- Efficiently Modeling Long Sequences with Structured State SpacesAlbert Gu, Karan Goel, Christopher RéICLR 2022 · 3,482 citations
- FEDformer: Frequency Enhanced Decomposed Transformer for Long-term Series ForecastingTian Zhou, Ziqing Ma, Qingsong Wen, Xue Wang et al.ICML 2022 · 2,912 citations
- Reformer: The Efficient TransformerNikita Kitaev, Lukasz Kaiser, Anselm LevskayaICLR 2020 · 2,878 citations
Related papers
- Dynamic Gaussian Mixture based Deep Generative Model For Robust Forecasting on Sparse Multivariate Time SeriesYinjun Wu, Jingchao Ni, Wei Cheng, Bo Zong et al.AAAI 2021 · 76 citations
- Learning Decomposed Spatial Relations for Multi-Variate Time-Series ModelingYuchen Fang, Kan Ren, Caihua Shan, Yifei Shen et al.AAAI 2023 · 23 citations
- Considering Nonstationary within Multivariate Time Series with Variational Hierarchical Transformer for ForecastingMuyao Wang, Wenchao Chen, Bo ChenAAAI 2024 · 13 citations
- FourierGNN: Rethinking Multivariate Time Series Forecasting from a Pure Graph PerspectiveKun Yi, Qi Zhang, Wei Fan, Hui He et al.NeurIPS 2023 · 359 citations
- Adaptive Frequency Pathways for Spatiotemporal ForecastingYanjun Qin, Yuchen Fang, Xinke Jiang, Hao Miao et al.AAAI 2026
