Towards a General Time Series Forecasting Model with Unified Representation and Adaptive Transfer
Yihang Wang, Yuying Qiu, Peng Chen, Kai Zhao, Yang Shu, Zhongwen Rao, Lujia Pan, Bin Yang, Chenjuan Guo
Abstract
With the growing availability of multi-domain time series data, there is an increasing demand for general forecasting models pre-trained on multisource datasets to support diverse downstream prediction scenarios. Existing time series foundation models primarily focus on scaling up pre-training datasets and model sizes to enhance generalization performance. In this paper, we take a different approach by addressing two critical aspects of general forecasting models: (1) how to derive unified representations from heterogeneous multidomain time series data, and (2) how to effectively capture domain-specific features to enable adaptive transfer across various downstream scenarios. To address the first aspect, we propose Decomposed Frequency Learning as the pre-training task, which leverages frequency-based masking and reconstruction to decompose coupled semantic information in time series, resulting in unified representations across domains. For the second aspect, we introduce the Time Series Register, which captures domain-specific representations during pre-training and enhances adaptive transferability to downstream tasks. Our model achieves the state-of-the-art forecasting performance on seven real-world benchmarks, demonstrating remarkable few-shot and zero-shot capabilities.
Ask about this paper
Your agent reads all of it.
Lune indexed this paper to the last equation, along with the top-tier papers that cite it. Ask a question and the answer quotes them.
Your agent calls
Luneget_paper_fulltext
Free to start. No credit card required.
Terminal
Install the CLIlune papers fulltext d9e623cd-0b1b-4ccf-b505-eb4edf4e2411Cited by top-tier papers14
- Enhancing Time Series Forecasting through Selective Representation Spaces: A Patch PerspectiveXingjian Wu, Xiangfei Qiu, Hanyin Cheng, Zhengyu Li et al.NeurIPS 2025 · 58 citations
- Aurora: Towards Universal Generative Multimodal Time Series ForecastingXingjian Wu, Jianxin Jin, Wanghui Qiu, Peng Chen et al.ICLR 2026 · 33 citations
- CoRA: Boosting Time Series Foundation Models for Multivariate Forecasting through Correlation-aware AdapterHanyin Cheng, Xingjian Wu, Yang Shu, Zhongwen Rao et al.ICLR 2026 · 10 citations
- Learning to Factorize Spatio-Temporal Foundation ModelsSiru Zhong, Junjie Qiu, Yangyu Wu, Xingchen Zou et al.NeurIPS 2025 · 5 citations
- Towards Measuring and Modeling Geometric Structures in Time Series Forecasting via Image ModalityMingyang Yu, Xiahui Guo, Peng Chen, Zhenkai Li et al.ACM MM 2025 · 3 citations
Builds on29
- Autoformer: Decomposition Transformers with Auto-Correlation for Long-Term Series ForecastingHaixu Wu, Jiehui Xu, Jianmin Wang, Mingsheng LongNeurIPS 2021 · 5,824 citations
- Are Transformers Effective for Time Series Forecasting?Ailing Zeng, Muxi Chen, Lei Zhang, Qiang XuAAAI 2023 · 3,619 citations
- FEDformer: Frequency Enhanced Decomposed Transformer for Long-term Series ForecastingTian Zhou, Ziqing Ma, Qingsong Wen, Xue Wang et al.ICML 2022 · 2,912 citations
- iTransformer: Inverted Transformers Are Effective for Time Series ForecastingYong Liu, Tengge Hu, Haoran Zhang, Haixu Wu et al.ICLR 2024 · 1,703 citations
- One Fits All: Power General Time Series Analysis by Pretrained LMTian Zhou, Peisong Niu, Xue Wang, Liang Sun et al.NeurIPS 2023 · 1,178 citations
Related papers
- GTM: A General Time-series Model for Enhanced Representation Learning of Time-Series dataCheng He, Xu Huang, Gangwei Jiang, Zhaoyi Li et al.ICLR 2026 · 4 citations
- TimeCAP: A Channel-Aware Pre-Training Framework for Multivariate Time Series ForecastingChuanru Ren, Yao Lu, Tianjin Huang, Haowen Zheng et al.AAAI 2026
- FAT: Frequency-Aware Pretraining for Enhanced Time-Series Representation LearningRui Cheng, Xiangfei Jia, Qing Li, Rong Xing et al.KDD 2025 · 2 citations
- DAM: Towards a Foundation Model for ForecastingLuke Nicholas Darlow, Qiwen Deng, Ahmed Hassan, Martin Asenov et al.ICLR 2024 · 11 citations
- Large Pre-trained time series models for cross-domain Time series analysis tasksHarshavardhan Kamarthi, B. Aditya PrakashNeurIPS 2024 · 40 citations
