TimePro: Efficient Multivariate Long-term Time Series Forecasting with Variable- and Time-Aware Hyper-state
Xiaowen Ma, Zhen-Liang Ni, Shuai Xiao, Xinghao Chen
Abstract
In long-term time series forecasting, different variables often influence the target variable over distinct time intervals, a challenge known as the multi-delay issue. Traditional models typically process all variables or time points uniformly, which limits their ability to capture complex variable relationships and obtain non-trivial time representations. To address this issue, we propose TimePro, an innovative Mamba-based model that constructs variate-and time-aware hyper-states. Unlike conventional approaches that merely transfer plain states across variable or time dimensions, TimePro preserves the fine-grained temporal features of each variate token and adaptively selects the focused time points to tune the plain state. The reconstructed hyper-state can perceive both variable relationships and salient temporal information, which helps the model make accurate forecasting. In experiments, TimePro performs competitively on eight real-world long-term forecasting benchmarks with satisfactory linear complexity.
Ask about this paper
Your agent reads all of it.
Lune indexed this paper to the last equation, along with the top-tier papers that cite it. Ask a question and the answer quotes them.
Your agent calls
Luneget_paper_fulltext
Free to start. No credit card required.
Terminal
Install the CLIlune papers fulltext eb805057-5fc8-4a6a-bcb8-92fe3f4d8f96Cited by top-tier papers5
- OLinear: A Linear Model for Time Series Forecasting in Orthogonally Transformed DomainWenzhen Yue, Yong Liu, Hao Wang, Haoxuan Li et al.NeurIPS 2025 · 42 citations
- TinyViM: Frequency Decoupling for Tiny Hybrid Vision MambaXiaowen Ma, Zhenliang Ni, Xinghao ChenICCV 2025 · 16 citations
- Enhancing Multivariate Time Series Forecasting with Global Temporal RetrievalFanpu Cao, Lu Dai, Jindong Han, Hui XiongICLR 2026 · 7 citations
- FACT: Fine-grained Across-variable Convolution for Multivariate Time Series ForecastingHuiqiang Wang, Jieming Shi, Qing LiICLR 2026
- TimeCAP: A Channel-Aware Pre-Training Framework for Multivariate Time Series ForecastingChuanru Ren, Yao Lu, Tianjin Huang, Haowen Zheng et al.AAAI 2026
Builds on15
- Informer: Beyond Efficient Transformer for Long Sequence Time-Series ForecastingHaoyi Zhou, Shanghang Zhang, Jieqi Peng, Shuai Zhang et al.AAAI 2021 · 7,289 citations
- Autoformer: Decomposition Transformers with Auto-Correlation for Long-Term Series ForecastingHaixu Wu, Jiehui Xu, Jianmin Wang, Mingsheng LongNeurIPS 2021 · 5,824 citations
- Are Transformers Effective for Time Series Forecasting?Ailing Zeng, Muxi Chen, Lei Zhang, Qiang XuAAAI 2023 · 3,619 citations
- Efficiently Modeling Long Sequences with Structured State SpacesAlbert Gu, Karan Goel, Christopher RéICLR 2022 · 3,482 citations
- iTransformer: Inverted Transformers Are Effective for Time Series ForecastingYong Liu, Tengge Hu, Haoran Zhang, Haixu Wu et al.ICLR 2024 · 1,703 citations
Related papers
- FedRMamba: Federated Residual Mamba for Multivariate Time-Series ForecastingZhiwei Hu, Liang Zhang, Guangxu ZhuWWW 2026
- TimeViper: A Hybrid Mamba-Transformer Vision-Language Model for Efficient Long Video UnderstandingBoshen Xu, Zihan Xiao, Jiaze Li, Jianzhong Ju et al.CVPR 2026 · 5 citations
- Mamba Hawkes Process for Event Sequence ModelingShan Dai, Yuyang Shen, Yuyang Liang, Chenhao Ma et al.WWW 2026
- Affirm: Interactive Mamba with Adaptive Fourier Filters for Long-term Time Series ForecastingYuhan Wu, Xiyu Meng, Huajin Hu, Junru Zhang et al.AAAI 2025 · 24 citations
- Decomposed Spatio-Temporal Mamba for Long-Term Traffic PredictionSicheng He, Junzhong Ji, Minglong LeiAAAI 2025 · 20 citations
