MixLinear: Extreme Low Resource Multivariate Time Series Forecasting with 0.1K Parameters
Aitian Ma, Dongsheng Luo, Mo Sha
摘要
Recently, there has been a growing interest in Long-term Time Series Forecasting (LTSF), which involves predicting long-term future values by analyzing a large amount of historical time-series data to identify patterns and trends. Significant challenges exist in LTSF due to its complex temporal dependencies and high computational demands. Although Transformer-based models offer high forecasting accuracy, they are often too compute-intensive to be deployed on devices with hardware constraints. In this paper, we propose MixLinear, which synergistically combines segment-based trend extraction in the time domain with adaptive low-rank spectral filtering in the frequency domain. Our approach exploits the complementary structural sparsity of time series: local temporal patterns are efficiently captured through mathematically linear transformations that separate intra-segment and inter-segment correlations, while global trends are compressed into an ultralow-dimensional frequency latent space through learnable rank-constrained filters. By reducing the parameter scale of a downsampled n-length input/output onelayer linear model from O(n 2 ) to O(n), MixLinear achieves efficient computation without sacrificing accuracy. Extensive evaluations show that MixLinear achieves forecasting performance comparable to existing models with significantly fewer parameters (0.1K), which makes it well-suited for deployment on devices with limited computational capacity. Recent research has started to process local and global components differently. One approach, found in models like DeepGate (Park et al., 2022) , decomposes the time series first. However, such a method *
问问这篇 Paper
智能体会读完全文。
Lune 把这篇 Paper 索引到了每一个公式,引用它的顶会 Paper 也一样。你提问,回答直接引用原文。
引用它的顶会 Paper2
- Efficient Source-Free Time-Series Adaptation via Parameter Subspace DisentanglementGaurav Patel, Christopher Michael Sandino, Behrooz Mahasseni, Ellen L. Zippi 等ICLR 2025
- TimeSeed: Effective Time Series Forecasting with Sparse Endogenous VariablesZhaowang Wu, Kaixin Deng, Hua YanICML 2026
它引用的顶会 Paper20
- Language Models are Few-Shot LearnersTom B. Brown, Benjamin Mann, Nick Ryder, Melanie Subbiah 等NeurIPS 2020 · 被引用 64,255 次
- An Image is Worth 16x16 Words: Transformers for Image Recognition at ScaleAlexey Dosovitskiy, Lucas Beyer, Alexander Kolesnikov, Dirk Weissenborn 等ICLR 2021 · 被引用 21,477 次
- Informer: Beyond Efficient Transformer for Long Sequence Time-Series ForecastingHaoyi Zhou, Shanghang Zhang, Jieqi Peng, Shuai Zhang 等AAAI 2021 · 被引用 7,289 次
- Autoformer: Decomposition Transformers with Auto-Correlation for Long-Term Series ForecastingHaixu Wu, Jiehui Xu, Jianmin Wang, Mingsheng LongNeurIPS 2021 · 被引用 5,824 次
- MLP-Mixer: An all-MLP Architecture for VisionIlya O. Tolstikhin, Neil Houlsby, Alexander Kolesnikov, Lucas Beyer 等NeurIPS 2021 · 被引用 3,862 次
相关 Paper
- FEDformer: Frequency Enhanced Decomposed Transformer for Long-term Series ForecastingTian Zhou, Ziqing Ma, Qingsong Wen, Xue Wang 等ICML 2022 · 被引用 2,912 次
- SparseTSF: Modeling Long-term Time Series Forecasting with 1k ParametersShengsheng Lin, Weiwei Lin, Wentai Wu, Haojun Chen 等ICML 2024 · 被引用 155 次
- TimeBase: The Power of Minimalism in Efficient Long-term Time Series ForecastingQihe Huang, Zhengyang Zhou, Kuo Yang, Zhongchao Yi 等ICML 2025
- WaveletMixer: A Multi-Resolution Wavelets Based MLP-Mixer for Multivariate Long-Term Time Series ForecastingZichi Zhang, Tuan Dung Pham, Yimeng An, Ngoc Phu Doan 等AAAI 2025 · 被引用 3 次
- HMformer: Unleashing Transformer's Potential for Time Series Forecasting via Hierarchical Multi-Scale ModelingRenjun Huang, Han Xiao, Bingqing Li, Baili Zhang 等AAAI 2026
