MDMLP-EIA: Multi-domain Dynamic MLPs with Energy Invariant Attention for Time Series Forecasting
Hu Zhang, Zhien Dai, Zhaohui Tang, Yongfang Xie
Abstract
Time series forecasting is essential across diverse domains. While MLP-based methods have gained attention for achieving Transformer-comparable performance with fewer parameters and better robustness, they face critical limitations including loss of weak seasonal signals, capacity constraints in weight-sharing MLPs, and insufficient channel fusion in channel-independent strategies. To address these challenges, we propose MDMLP-EIA (Multi-domain Dynamic MLPs with Energy Invariant Attention) with three key innovations. First, we develop an adaptive fused dual-domain seasonal MLP that categorizes seasonal signals into strong and weak components. It employs an adaptive zero-initialized channel fusion strategy to minimize noise interference while effectively integrating predictions. Second, we introduce an energy invariant attention mechanism that adaptively focuses on different feature channels within trend and seasonal predictions across time steps. This mechanism maintains constant total signal energy to align with the decomposition-prediction-reconstruction framework and enhance robustness against disturbances. Third, we propose a dynamic capacity adjustment mechanism for channel-independent MLPs. This mechanism scales neuron count with the square root of channel count, ensuring sufficient capacity as channels increase. Extensive experiments across nine benchmark datasets demonstrate that MDMLP-EIA achieves state-of-the-art performance in both prediction accuracy and computational efficiency.
Ask about this paper
Your agent reads all of it.
Lune indexed this paper to the last equation, along with the top-tier papers that cite it. Ask a question and the answer quotes them.
Your agent calls
Luneget_paper_fulltext
Free to start. No credit card required.
Terminal
Install the CLIlune papers fulltext 9ac65d3c-c6b1-4d20-b293-0a7c81384b1dBuilds on15
- Autoformer: Decomposition Transformers with Auto-Correlation for Long-Term Series ForecastingHaixu Wu, Jiehui Xu, Jianmin Wang, Mingsheng LongNeurIPS 2021 · 5,824 citations
- Frequency-domain MLPs are More Effective Learners in Time Series ForecastingKun Yi, Qi Zhang, Wei Fan, Shoujin Wang et al.NeurIPS 2023 · 567 citations
- TimesNet: Temporal 2D-Variation Modeling for General Time Series AnalysisHaixu Wu, Tengge Hu, Yong Liu, Hang Zhou et al.ICLR 2023 · 423 citations
- NHITS: Neural Hierarchical Interpolation for Time Series ForecastingCristian Challu, Kin G. Olivares, Boris N. Oreshkin, Federico Garza Ramírez et al.AAAI 2023 · 420 citations
- FITS: Modeling Time Series with 10k ParametersZhijian Xu, Ailing Zeng, Qiang XuICLR 2024 · 259 citations
Related papers
- Adaptive Multi-Scale Decomposition Framework for Time Series ForecastingYifan Hu, Peiyuan Liu, Peng Zhu, Dawei Cheng et al.AAAI 2025 · 60 citations
- Unifying Channel Independence and Mixing: Multi-Scale Patch Recursion for Global-Local Representation Synergy in Multivariate Time Series ForecastingWenhao Zhang, Chun Zhang, Wei Bai, Ning Zhang et al.AAAI 2026
- InParformer: Evolutionary Decomposition Transformers with Interactive Parallel Attention for Long-Term Time Series ForecastingHaizhou Cao, Zhenhao Huang, Tiechui Yao, Jue Wang et al.AAAI 2023 · 29 citations
- HMformer: Unleashing Transformer's Potential for Time Series Forecasting via Hierarchical Multi-Scale ModelingRenjun Huang, Han Xiao, Bingqing Li, Baili Zhang et al.AAAI 2026
- Amplifier: Bringing Attention to Neglected Low-Energy Components in Time Series ForecastingJingru Fei, Kun Yi, Wei Fan, Qi Zhang et al.AAAI 2025 · 30 citations
