MICN: Multi-scale Local and Global Context Modeling for Long-term Series Forecasting
Huiqiang Wang, Jian Peng, Feihu Huang, Jince Wang, Junhui Chen, Yifei Xiao
Abstract
Recently, Transformer-based methods have achieved surprising performance in the field of long-term series forecasting, but the attention mechanism for computing global correlations entails high complexity. And they do not allow for targeted modeling of local features as CNN structures do. To solve the above problems, we propose to combine local features and global correlations to capture the overall view of time series (e.g., fluctuations, trends). To fully exploit the underlying information in the time series, a multi-scale branch structure is adopted to model different potential patterns separately. Each pattern is extracted with down-sampled convolution and isometric convolution for local features and global correlations, respectively. In addition to being more effective, our proposed method, termed as Multi-scale Isometric Convolution Network (MICN), is more efficient with linear complexity about the sequence length with suitable convolution kernels. Our experiments on six benchmark datasets show that compared with state-of-the-art methods, MICN yields 17.2% and 21.6% relative improvements for multivariate and univariate time series, respectively.
Ask about this paper
Ask your agent about it.
Lune has read the top-tier papers around this one, so every answer names the papers it rests on.
Cited by top-tier papers88
- TimeMixer: Decomposable Multiscale Mixing for Time Series ForecastingShiyu Wang, Haixu Wu, Xiaoming Shi, Tengge Hu et al.ICLR 2024 · 573 citations
- ModernTCN: A Modern Pure Convolution Structure for General Time Series AnalysisDonghao Luo, Xue WangICLR 2024 · 392 citations
- TFB: Towards Comprehensive and Fair Benchmarking of Time Series Forecasting MethodsXiangfei Qiu, Jilin Hu, Lekui Zhou, Xingjian Wu et al.VLDB 2024 · 292 citations
- Koopa: Learning Non-stationary Time Series Dynamics with Koopman PredictorsYong Liu, Chenyu Li, Jianmin Wang, Mingsheng LongNeurIPS 2023 · 284 citations
- MSGNet: Learning Multi-Scale Inter-series Correlations for Multivariate Time Series ForecastingWanlin Cai, Yuxuan Liang, Xianggen Liu, Jianshuai Feng et al.AAAI 2024 · 239 citations
Related papers
- FEDformer: Frequency Enhanced Decomposed Transformer for Long-term Series ForecastingTian Zhou, Ziqing Ma, Qingsong Wen, Xue Wang et al.ICML 2022 · 2,912 citations
- MPTSNet: Integrating Multiscale Periodic Local Patterns and Global Dependencies for Multivariate Time Series ClassificationYang Mu, Muhammad Shahzad, Xiao Xiang ZhuAAAI 2025 · 19 citations
- Sparse-Scale Transformer with Bidirectional Awareness for Time Series ForecastingYing Liu, Bo Liu, Sheng Huang, Gang Luo et al.AAAI 2026
- HMformer: Unleashing Transformer's Potential for Time Series Forecasting via Hierarchical Multi-Scale ModelingRenjun Huang, Han Xiao, Bingqing Li, Baili Zhang et al.AAAI 2026
- InParformer: Evolutionary Decomposition Transformers with Interactive Parallel Attention for Long-Term Time Series ForecastingHaizhou Cao, Zhenhao Huang, Tiechui Yao, Jue Wang et al.AAAI 2023 · 29 citations
