Learning Pattern-Specific Experts for Time Series Forecasting Under Patch-level Distribution Shift
Yanru Sun, Zongxia Xie, Emadeldeen Eldele, Dongyue Chen, Qinghua Hu, Min Wu
Abstract
Time series forecasting, which aims to predict future values based on historical data, has garnered significant attention due to its broad range of applications. However, real-world time series often exhibit complex non-uniform distribution with varying patterns across segments, such as season, operating condition, or semantic meaning, making accurate forecasting challenging. Existing approaches, which typically train a single model to capture all these diverse patterns, often struggle with the pattern drifts between patches and may lead to poor generalization. To address these challenges, we propose TFPS, a novel architecture that leverages pattern-specific experts for more accurate and adaptable time series forecasting. TFPS employs a dual-domain encoder to capture both time-domain and frequency-domain features, enabling a more comprehensive understanding of temporal dynamics. It then uses subspace clustering to dynamically identify distinct patterns across data patches. Finally, pattern-specific experts model these unique patterns, delivering tailored predictions for each patch. By explicitly learning and adapting to evolving patterns, TFPS achieves significantly improved forecasting accuracy. Extensive experiments on real-world datasets demonstrate that TFPS outperforms state-of-the-art methods, particularly in long-term forecasting, through its dynamic and pattern-aware learning approach. The data and codes are available: https://github.com/syrGitHub/TFPS.
Ask about this paper
Your agent reads all of it.
Lune indexed this paper to the last equation, along with the top-tier papers that cite it. Ask a question and the answer quotes them.
Your agent calls
Luneget_paper_fulltext
Free to start. No credit card required.
Terminal
Install the CLIlune papers fulltext 04da12a1-84d3-4a22-91b4-1746e3b0e900Cited by top-tier papers4
- Patch-wise Structural Loss for Time Series ForecastingDilfira Kudrat, Zongxia Xie, Yanru Sun, Tianyu Jia et al.ICML 2025
- Dynamic TMoE: A Drift-Aware Dynamic Mixture of Experts Framework for Non-Stationary Time Series ForecastingJiawen Zhu, Shuhan Liu, Di Weng, Yingcai WuICML 2026
- SEED: Spectral Entropy-Guided Evaluation of Spatial-Temporal Dependencies for Multivariate Time Series ForecastingFeng Xiong, Zongxia Xie, Yanru Sun, Haoyu Wang et al.AAAI 2026
- Crisp: A Spectral-Based Interaction Strategy for Multivariate Time Series ForecastingBinwu Wang, Gaoyun Lin, Jiaming Ma, Qihe Huang et al.ICML 2026
Builds on36
- Informer: Beyond Efficient Transformer for Long Sequence Time-Series ForecastingHaoyi Zhou, Shanghang Zhang, Jieqi Peng, Shuai Zhang et al.AAAI 2021 · 7,289 citations
- Autoformer: Decomposition Transformers with Auto-Correlation for Long-Term Series ForecastingHaixu Wu, Jiehui Xu, Jianmin Wang, Mingsheng LongNeurIPS 2021 · 5,824 citations
- Are Transformers Effective for Time Series Forecasting?Ailing Zeng, Muxi Chen, Lei Zhang, Qiang XuAAAI 2023 · 3,619 citations
- FEDformer: Frequency Enhanced Decomposed Transformer for Long-term Series ForecastingTian Zhou, Ziqing Ma, Qingsong Wen, Xue Wang et al.ICML 2022 · 2,912 citations
- iTransformer: Inverted Transformers Are Effective for Time Series ForecastingYong Liu, Tengge Hu, Haoran Zhang, Haixu Wu et al.ICLR 2024 · 1,703 citations
Related papers
- TimeMosaic: Temporal Heterogeneity Guided Time Series Forecasting via Adaptive Granularity Patch and Segment-wise DecodingKuiye Ding, Fanda Fan, Chunyi Hou, Zheya Wang et al.AAAI 2026 · 4 citations
- Many Minds, One Goal: Time Series Forecasting via Sub-task Specialization and Inter-agent CooperationQihe Huang, Zhengyang Zhou, Yangze Li, Kuo Yang et al.NeurIPS 2025 · 11 citations
- RePatch: Learning Entropy-Guided Patch Structures with Quantized Representations for Time Series ForecastingHanbin Xiao, Xun Zhou, Rui Huang, Xiucheng Li et al.KDD 2026
- Towards Non-Stationary Time Series Forecasting with Temporal Stabilization and Frequency DifferencingJunkai Lu, Peng Chen, Chenjuan Guo, Yang Shu et al.AAAI 2026 · 1 citation
- TimePerceiver: An Encoder-Decoder Framework for Generalized Time-Series ForecastingJaebin Lee, Hankook LeeNeurIPS 2025 · 1 citation
