HDMixer: Hierarchical Dependency with Extendable Patch for Multivariate Time Series Forecasting
Qihe Huang, Lei Shen, Ruixin Zhang, Jiahuan Cheng, Shouhong Ding, Zhengyang Zhou, Yang Wang
Abstract
Multivariate time series (MTS) prediction has been widely adopted in various scenarios. Recently, some methods have employed patching to enhance local semantics and improve model performance. However, length-fixed patch are prone to losing temporal boundary information, such as complete peaks and periods. Moreover, existing methods mainly focus on modeling long-term dependencies across patches, while paying little attention to other dimensions (e.g., short-term dependencies within patches and complex interactions among cross-variavle patches). To address these challenges, we propose a pure MLP-based HDMixer, aiming to acquire patches with richer semantic information and efficiently modeling hierarchical interactions. Specifically, we design a Length-Extendable Patcher (LEP) tailored to MTS, which enriches the boundary information of patches and alleviates semantic incoherence in series. Subsequently, we devise a Hierarchical Dependency Explorer (HDE) based on pure MLPs. This explorer effectively models short-term dependencies within patches, long-term dependencies across patches, and complex interactions among variables. Extensive experiments on 9 real-world datasets demonstrate the superiority of our approach. The code is available at https://github.com/hqh0728/HDMixer.
Ask about this paper
Your agent reads all of it.
Lune indexed this paper to the last equation, along with the top-tier papers that cite it. Ask a question and the answer quotes them.
Your agent calls
Luneget_paper_fulltext
Free to start. No credit card required.
Terminal
Install the CLIlune papers fulltext 082d473d-8892-4bdf-8440-90d65e2deb88Cited by top-tier papers36
- CycleNet: Enhancing Time Series Forecasting through Modeling Periodic PatternsShengsheng Lin, Weiwei Lin, Xinyi Hu, Wentai Wu et al.NeurIPS 2024 · 213 citations
- DBLoss: Decomposition-based Loss Function for Time Series ForecastingXiangfei Qiu, Xingjian Wu, Hanyin Cheng, Xvyuan Liu et al.NeurIPS 2025 · 61 citations
- Enhancing Time Series Forecasting through Selective Representation Spaces: A Patch PerspectiveXingjian Wu, Xiangfei Qiu, Hanyin Cheng, Zhengyu Li et al.NeurIPS 2025 · 58 citations
- TAB: Unified Benchmarking of Time Series Anomaly Detection MethodsXiangfei Qiu, Zhe Li, Wanghui Qiu, Shiyan Hu et al.VLDB 2025 · 57 citations
- Rethinking Irregular Time Series Forecasting: A Simple Yet Effective BaselineXvyuan Liu, Xiangfei Qiu, Xingjian Wu, Zhengyu Li et al.AAAI 2026 · 42 citations
Builds on20
- Autoformer: Decomposition Transformers with Auto-Correlation for Long-Term Series ForecastingHaixu Wu, Jiehui Xu, Jianmin Wang, Mingsheng LongNeurIPS 2021 · 5,824 citations
- MLP-Mixer: An all-MLP Architecture for VisionIlya O. Tolstikhin, Neil Houlsby, Alexander Kolesnikov, Lucas Beyer et al.NeurIPS 2021 · 3,862 citations
- FEDformer: Frequency Enhanced Decomposed Transformer for Long-term Series ForecastingTian Zhou, Ziqing Ma, Qingsong Wen, Xue Wang et al.ICML 2022 · 2,912 citations
- Connecting the Dots: Multivariate Time Series Forecasting with Graph Neural NetworksZonghan Wu, Shirui Pan, Guodong Long, Jing Jiang et al.KDD 2020 · 1,738 citations
- Non-stationary Transformers: Exploring the Stationarity in Time Series ForecastingYong Liu, Haixu Wu, Jianmin Wang, Mingsheng LongNeurIPS 2022 · 1,080 citations
Related papers
- A Multi-Scale Decomposition MLP-Mixer for Time Series AnalysisShuhan Zhong, Sizhe Song, Weipeng Zhuo, Guanyao Li et al.VLDB 2024 · 48 citations
- WPMixer: Efficient Multi-Resolution Mixing for Long-Term Time Series ForecastingMd Mahmuddun Nabi Murad, Mehmet Aktukmak, Yasin YilmazAAAI 2025 · 17 citations
- TSMixer: Lightweight MLP-Mixer Model for Multivariate Time Series ForecastingVijay Ekambaram, Arindam Jati, Nam Nguyen, Phanwadee Sinthong et al.KDD 2023 · 221 citations
- Unlocking the Power of Patch: Patch-Based MLP for Long-Term Time Series ForecastingPeiwang Tang, Weitai ZhangAAAI 2025 · 42 citations
- TimeMixer: Decomposable Multiscale Mixing for Time Series ForecastingShiyu Wang, Haixu Wu, Xiaoming Shi, Tengge Hu et al.ICLR 2024 · 573 citations
