Learning Latent Seasonal-Trend Representations for Time Series Forecasting
Zhiyuan Wang, Xovee Xu, Weifeng Zhang, Goce Trajcevski, Ting Zhong, Fan Zhou
Abstract
Forecasting complex time series is ubiquitous and vital in a range of applications but challenging. Recent advances endeavor to achieve progress by incorporating various deep learning techniques (e.g., RNN and Transformer) into sequential models. However, clear patterns are still hard to extract since time series are often composed of several intricately entangled components. Motivated by the success of disentangled variational autoencoder in computer vision and classical time series decomposition, we plan to infer a couple of representations that depict seasonal and trend components of time series. To achieve this goal, we propose LaST, which, based on variational inference, aims to disentangle the seasonal-trend representations in the latent space. Furthermore, LaST supervises and disassociates representations from the perspectives of themselves and input reconstruction, and introduces a series of auxiliary objectives. Extensive experiments prove that LaST achieves state-of-the-art performance on time series forecasting task against the most advanced representation learning and end-to-end forecasting models. For reproducibility, our implementation is publicly available on Github 1 .
Ask about this paper
Your agent reads all of it.
Lune indexed this paper to the last equation, along with the top-tier papers that cite it. Ask a question and the answer quotes them.
Your agent calls
Luneget_paper_fulltext
Free to start. No credit card required.
Terminal
Install the CLIlune papers fulltext 9f3a656b-da31-4de9-8f44-1cefbc38be21Cited by top-tier papers20
- SimMTM: A Simple Pre-Training Framework for Masked Time-Series ModelingJiaxiang Dong, Haixu Wu, Haoran Zhang, Li Zhang et al.NeurIPS 2023 · 225 citations
- Tiny Time Mixers (TTMs): Fast Pre-trained Models for Enhanced Zero/Few-Shot Forecasting of Multivariate Time SeriesVijay Ekambaram, Arindam Jati, Pankaj Dayama, Sumanta Mukherjee et al.NeurIPS 2024 · 207 citations
- Drift doesn't Matter: Dynamic Decomposition with Diffusion Reconstruction for Unstable Multivariate Time Series Anomaly DetectionChengsen Wang, Zirui Zhuang, Qi Qi, Jingyu Wang et al.NeurIPS 2023 · 112 citations
- Fredformer: Frequency Debiased Transformer for Time Series ForecastingXihao Piao, Zheng Chen, Taichi Murayama, Yasuko Matsubara et al.KDD 2024 · 73 citations
- Soft Contrastive Learning for Time SeriesSeunghan Lee, Taeyoung Park, Kibok LeeICLR 2024 · 63 citations
Builds on11
- Informer: Beyond Efficient Transformer for Long Sequence Time-Series ForecastingHaoyi Zhou, Shanghang Zhang, Jieqi Peng, Shuai Zhang et al.AAAI 2021 · 7,289 citations
- Autoformer: Decomposition Transformers with Auto-Correlation for Long-Term Series ForecastingHaixu Wu, Jiehui Xu, Jianmin Wang, Mingsheng LongNeurIPS 2021 · 5,824 citations
- N-BEATS: Neural basis expansion analysis for interpretable time series forecastingBoris N. Oreshkin, Dmitri Carpov, Nicolas Chapados, Yoshua BengioICLR 2020 · 1,550 citations
- TS2Vec: Towards Universal Representation of Time SeriesZhihan Yue, Yujing Wang, Juanyong Duan, Tianmeng Yang et al.AAAI 2022 · 938 citations
- CLUB: A Contrastive Log-ratio Upper Bound of Mutual InformationPengyu Cheng, Weituo Hao, Shuyang Dai, Jiachang Liu et al.ICML 2020 · 512 citations
Related papers
- CoST: Contrastive Learning of Disentangled Seasonal-Trend Representations for Time Series ForecastingGerald Woo, Chenghao Liu, Doyen Sahoo, Akshat Kumar et al.ICLR 2022 · 468 citations
- From Observations to States: Latent Time Series ForecastingJie Yang, Yifan Hu, Yuante Li, Kexin Zhang et al.ICML 2026 · 3 citations
- Temporal Latent Auto-Encoder: A Method for Probabilistic Multivariate Time Series ForecastingNam Nguyen, Brian QuanzAAAI 2021 · 87 citations
- Generative Time Series Forecasting with Diffusion, Denoise, and DisentanglementYan Li, Xinjiang Lu, Yaqing Wang, Dejing DouNeurIPS 2022 · 203 citations
- FEDformer: Frequency Enhanced Decomposed Transformer for Long-term Series ForecastingTian Zhou, Ziqing Ma, Qingsong Wen, Xue Wang et al.ICML 2022 · 2,912 citations
