Towards a General Time Series Forecasting Model with Unified Representation and Adaptive Transfer
Yihang Wang, Yuying Qiu, Peng Chen, Kai Zhao, Yang Shu, Zhongwen Rao, Lujia Pan, Bin Yang, Chenjuan Guo
摘要
With the growing availability of multi-domain time series data, there is an increasing demand for general forecasting models pre-trained on multisource datasets to support diverse downstream prediction scenarios. Existing time series foundation models primarily focus on scaling up pre-training datasets and model sizes to enhance generalization performance. In this paper, we take a different approach by addressing two critical aspects of general forecasting models: (1) how to derive unified representations from heterogeneous multidomain time series data, and (2) how to effectively capture domain-specific features to enable adaptive transfer across various downstream scenarios. To address the first aspect, we propose Decomposed Frequency Learning as the pre-training task, which leverages frequency-based masking and reconstruction to decompose coupled semantic information in time series, resulting in unified representations across domains. For the second aspect, we introduce the Time Series Register, which captures domain-specific representations during pre-training and enhances adaptive transferability to downstream tasks. Our model achieves the state-of-the-art forecasting performance on seven real-world benchmarks, demonstrating remarkable few-shot and zero-shot capabilities.
问问这篇 Paper
智能体会读完全文。
Lune 把这篇 Paper 索引到了最后一个公式,引用它的顶会 Paper 也一样。你提问,回答直接引用原文。
引用它的顶会 Paper14
- Enhancing Time Series Forecasting through Selective Representation Spaces: A Patch PerspectiveXingjian Wu, Xiangfei Qiu, Hanyin Cheng, Zhengyu Li 等NeurIPS 2025 · 被引用 58 次
- Aurora: Towards Universal Generative Multimodal Time Series ForecastingXingjian Wu, Jianxin Jin, Wanghui Qiu, Peng Chen 等ICLR 2026 · 被引用 33 次
- CoRA: Boosting Time Series Foundation Models for Multivariate Forecasting through Correlation-aware AdapterHanyin Cheng, Xingjian Wu, Yang Shu, Zhongwen Rao 等ICLR 2026 · 被引用 10 次
- Learning to Factorize Spatio-Temporal Foundation ModelsSiru Zhong, Junjie Qiu, Yangyu Wu, Xingchen Zou 等NeurIPS 2025 · 被引用 5 次
- Towards Measuring and Modeling Geometric Structures in Time Series Forecasting via Image ModalityMingyang Yu, Xiahui Guo, Peng Chen, Zhenkai Li 等ACM MM 2025 · 被引用 3 次
它引用的顶会 Paper29
- Autoformer: Decomposition Transformers with Auto-Correlation for Long-Term Series ForecastingHaixu Wu, Jiehui Xu, Jianmin Wang, Mingsheng LongNeurIPS 2021 · 被引用 5,824 次
- Are Transformers Effective for Time Series Forecasting?Ailing Zeng, Muxi Chen, Lei Zhang, Qiang XuAAAI 2023 · 被引用 3,619 次
- FEDformer: Frequency Enhanced Decomposed Transformer for Long-term Series ForecastingTian Zhou, Ziqing Ma, Qingsong Wen, Xue Wang 等ICML 2022 · 被引用 2,912 次
- iTransformer: Inverted Transformers Are Effective for Time Series ForecastingYong Liu, Tengge Hu, Haoran Zhang, Haixu Wu 等ICLR 2024 · 被引用 1,703 次
- One Fits All: Power General Time Series Analysis by Pretrained LMTian Zhou, Peisong Niu, Xue Wang, Liang Sun 等NeurIPS 2023 · 被引用 1,178 次
相关 Paper
- GTM: A General Time-series Model for Enhanced Representation Learning of Time-Series dataCheng He, Xu Huang, Gangwei Jiang, Zhaoyi Li 等ICLR 2026 · 被引用 4 次
- TimeCAP: A Channel-Aware Pre-Training Framework for Multivariate Time Series ForecastingChuanru Ren, Yao Lu, Tianjin Huang, Haowen Zheng 等AAAI 2026
- FAT: Frequency-Aware Pretraining for Enhanced Time-Series Representation LearningRui Cheng, Xiangfei Jia, Qing Li, Rong Xing 等KDD 2025 · 被引用 2 次
- DAM: Towards a Foundation Model for ForecastingLuke Nicholas Darlow, Qiwen Deng, Ahmed Hassan, Martin Asenov 等ICLR 2024 · 被引用 11 次
- Large Pre-trained time series models for cross-domain Time series analysis tasksHarshavardhan Kamarthi, B. Aditya PrakashNeurIPS 2024 · 被引用 40 次
