Predicting the Future by Retrieving the Past
Dazhao Du, Tao Han, Song Guo
Abstract
Deep learning models such as MLP, Transformer, and TCN have achieved remarkable success in univariate time series forecasting, typically relying on sliding window samples from historical data for training. However, while these models implicitly compress historical information into their parameters during training, they are unable to explicitly and dynamically access this global knowledge during inference, relying only on the local context within the lookback window. This results in an underutilization of rich patterns from the global history. To bridge this gap, we propose Predicting the Future by Retrieving the Past (PFRP), a novel approach that explicitly integrates global historical data to enhance forecasting accuracy. Specifically, we construct a Global Memory Bank (GMB) to effectively store and manage global historical patterns. A retrieval mechanism is then employed to extract similar patterns from the GMB, enabling the generation of global predictions. By adaptively combining these global predictions with the outputs of any local prediction model, PFRP produces more accurate and interpretable forecasts. Extensive experiments conducted on seven real-world datasets demonstrate that PFRP significantly enhances the average performance of advanced univariate forecasting models by 8.4%. Codes can be found in https://github.com/ddz16/ PFRP.
Ask about this paper
Your agent reads all of it.
Lune indexed this paper to the last equation, along with the top-tier papers that cite it. Ask a question and the answer quotes them.
Your agent calls
Luneget_paper_fulltext
Free to start. No credit card required.
Terminal
Install the CLIlune papers fulltext e1c48fbd-c993-4a4a-9a3a-399b575289e0Cited by top-tier papers1
Ask how each one uses itBuilds on18
- A Simple Framework for Contrastive Learning of Visual RepresentationsTing Chen, Simon Kornblith, Mohammad Norouzi, Geoffrey E. HintonICML 2020 · 24,064 citations
- Retrieval-Augmented Generation for Knowledge-Intensive NLP TasksPatrick Lewis, Ethan Perez, Aleksandra Piktus, Fabio Petroni et al.NeurIPS 2020 · 19,162 citations
- Informer: Beyond Efficient Transformer for Long Sequence Time-Series ForecastingHaoyi Zhou, Shanghang Zhang, Jieqi Peng, Shuai Zhang et al.AAAI 2021 · 7,289 citations
- Are Transformers Effective for Time Series Forecasting?Ailing Zeng, Muxi Chen, Lei Zhang, Qiang XuAAAI 2023 · 3,619 citations
- Retrieval Augmented Language Model Pre-TrainingKelvin Guu, Kenton Lee, Zora Tung, Panupong Pasupat et al.ICML 2020 · 2,937 citations
Related papers
- Enhancing Multivariate Time Series Forecasting with Global Temporal RetrievalFanpu Cao, Lu Dai, Jindong Han, Hui XiongICLR 2026 · 7 citations
- Retrieval Augmented Time Series ForecastingSungwon Han, Seungeon Lee, Meeyoung Cha, Sercan Ö. Arik et al.ICML 2025 · 2 citations
- A Memory Guided Transformer for Time Series ForecastingYunyao Cheng, Chenjuan Guo, Bin Yang, Haomin Yu et al.VLDB 2025 · 1 citation
- FiLM: Frequency improved Legendre Memory Model for Long-term Time Series ForecastingTian Zhou, Ziqing Ma, Xue Wang, Qingsong Wen et al.NeurIPS 2022 · 410 citations
- Joint Modeling of Local and Global Temporal Dynamics for Multivariate Time Series Forecasting with Missing ValuesXianfeng Tang, Huaxiu Yao, Yiwei Sun, Charu C. Aggarwal et al.AAAI 2020 · 138 citations
