SEMixer: Semantics Enhanced MLP-Mixer for Multiscale Mixing and Long-term Time Series Forecasting
Xu Zhang, Qitong Wang, Peng Wang, Wei Wang
摘要
Modeling multiscale patterns is crucial for long-term time series forecasting (TSF). However, redundancy and noise in time series, together with semantic gaps between non-adjacent scales, make the efficient alignment and integration of multi-scale temporal dependencies challenging. To address this, we propose SEMixer, a lightweight multiscale model designed for long-term TSF. SEMixer features two key components: a Random Attention Mechanism (RAM) and a Multiscale Progressive Mixing Chain (MPMC). RAM captures diverse time-patch interactions during training and aggregates them via dropout ensemble at inference, enhancing patchlevel semantics and enabling MLP-Mixer to better model multiscale dependencies. MPMC further stacks RAM and MLP-Mixer in a memory-efficient manner, achieving more effective temporal mixing. It addresses semantic gaps across scales and facilitates better multiscale modeling and forecasting performance. We not only validate the effectiveness of SEMixer on 10 public datasets, but also on the 2025 CCF AlOps Challenge based on 21GB real wireless network data, where SEMixer achieves third place. The code is available at https://github.com/Meteor-Stars/SEMixer . CCS Concepts • Information systems → Spatial-temporal systems; • Computing methodologies → Machine learning.
问问这篇 Paper
智能体会读完全文。
Lune 把这篇 Paper 索引到了每一个公式,引用它的顶会 Paper 也一样。你提问,回答直接引用原文。
它引用的顶会 Paper27
- Informer: Beyond Efficient Transformer for Long Sequence Time-Series ForecastingHaoyi Zhou, Shanghang Zhang, Jieqi Peng, Shuai Zhang 等AAAI 2021 · 被引用 7,289 次
- Autoformer: Decomposition Transformers with Auto-Correlation for Long-Term Series ForecastingHaixu Wu, Jiehui Xu, Jianmin Wang, Mingsheng LongNeurIPS 2021 · 被引用 5,824 次
- MLP-Mixer: An all-MLP Architecture for VisionIlya O. Tolstikhin, Neil Houlsby, Alexander Kolesnikov, Lucas Beyer 等NeurIPS 2021 · 被引用 3,862 次
- Are Transformers Effective for Time Series Forecasting?Ailing Zeng, Muxi Chen, Lei Zhang, Qiang XuAAAI 2023 · 被引用 3,619 次
- FEDformer: Frequency Enhanced Decomposed Transformer for Long-term Series ForecastingTian Zhou, Ziqing Ma, Qingsong Wen, Xue Wang 等ICML 2022 · 被引用 2,912 次
相关 Paper
- TSMixer: Lightweight MLP-Mixer Model for Multivariate Time Series ForecastingVijay Ekambaram, Arindam Jati, Nam Nguyen, Phanwadee Sinthong 等KDD 2023 · 被引用 221 次
- HDMixer: Hierarchical Dependency with Extendable Patch for Multivariate Time Series ForecastingQihe Huang, Lei Shen, Ruixin Zhang, Jiahuan Cheng 等AAAI 2024 · 被引用 91 次
- TimeMixer: Decomposable Multiscale Mixing for Time Series ForecastingShiyu Wang, Haixu Wu, Xiaoming Shi, Tengge Hu 等ICLR 2024 · 被引用 573 次
- Adaptive Multi-Scale Decomposition Framework for Time Series ForecastingYifan Hu, Peiyuan Liu, Peng Zhu, Dawei Cheng 等AAAI 2025 · 被引用 60 次
- WPMixer: Efficient Multi-Resolution Mixing for Long-Term Time Series ForecastingMd Mahmuddun Nabi Murad, Mehmet Aktukmak, Yasin YilmazAAAI 2025 · 被引用 17 次
