Proactive Model Adaptation Against Concept Drift for Online Time Series Forecasting
Lifan Zhao, Yanyan Shen
Abstract
Time series forecasting always faces the challenge of concept drift, where data distributions evolve over time, leading to a decline in forecast model performance. Existing solutions are based on online learning, which continually organize recent time series observations as new training samples and update model parameters according to the forecasting feedback on recent data. However, they overlook a critical issue: obtaining ground-truth future values of each sample should be delayed until after the forecast horizon. This delay creates a temporal gap between the training samples and the test sample. Our empirical analysis reveals that the gap can introduce concept drift, causing forecast models to adapt to outdated concepts. In this paper, we present Proceed, a novel proactive model adaptation framework for online time series forecasting. Proceed first estimates the concept drift between the recently used training samples and the current test sample. It then employs an adaptation generator to efficiently translate the estimated drift into parameter adjustments, proactively adapting the model to the test sample. To enhance the generalization capability of the framework, Proceed is trained on synthetic diverse concept drifts. Extensive experiments on five real-world datasets across various forecast models demonstrate that Proceed brings more performance improvements than the state-of-the-art online learning methods, significantly facilitating forecast models' resilience against concept drifts. Code is available at https://github.com/SJTU-DMTai/OnlineTSF .
Ask about this paper
Your agent reads all of it.
Lune indexed this paper to the last equation, along with the top-tier papers that cite it. Ask a question and the answer quotes them.
Your agent calls
Luneget_paper_fulltext
Free to start. No credit card required.
Terminal
Install the CLIlune papers fulltext 9610be10-2a1f-43bf-a8ba-0eee3e9064f0Cited by top-tier papers10
- Lifelong Test-Time Adaptation via Online Learning in Tracked Low-Dimensional SubspaceDexin Duan, Rui Xu, Peilin Liu, Fei WenNeurIPS 2025 · 7 citations
- Online time series prediction using feature adjustmentXiannan Huang, Shuhan Qiu, Jiayuan Du, Chao YangICLR 2026 · 5 citations
- Online Time Series Forecasting with Theoretical GuaranteesZijian Li, Changze Zhou, Minghao Fu, Sanjay Manjunath et al.NeurIPS 2025 · 3 citations
- Progressive Guessing to Fixed Point: Rethinking Human Motion Prediction with Deep Equilibrium ModelsDong Wei, Huaijiang Sun, Fan Liu, Yuhui ZhengCVPR 2026 · 1 citation
- Less is More: Unlocking Specialization of Time Series Foundation Models via Structured PruningLifan Zhao, Yanyan Shen, Zhaoyang Liu, Xue Wang et al.NeurIPS 2025 · 1 citation
Builds on24
- Informer: Beyond Efficient Transformer for Long Sequence Time-Series ForecastingHaoyi Zhou, Shanghang Zhang, Jieqi Peng, Shuai Zhang et al.AAAI 2021 · 7,289 citations
- Are Transformers Effective for Time Series Forecasting?Ailing Zeng, Muxi Chen, Lei Zhang, Qiang XuAAAI 2023 · 3,619 citations
- Connecting the Dots: Multivariate Time Series Forecasting with Graph Neural NetworksZonghan Wu, Shirui Pan, Guodong Long, Jing Jiang et al.KDD 2020 · 1,738 citations
- iTransformer: Inverted Transformers Are Effective for Time Series ForecastingYong Liu, Tengge Hu, Haoran Zhang, Haixu Wu et al.ICLR 2024 · 1,703 citations
- Dark Experience for General Continual Learning: a Strong, Simple BaselinePietro Buzzega, Matteo Boschini, Angelo Porrello, Davide Abati et al.NeurIPS 2020 · 1,494 citations
Related papers
- DDG-DA: Data Distribution Generation for Predictable Concept Drift AdaptationWendi Li, Xiao Yang, Weiqing Liu, Yingce Xia et al.AAAI 2022 · 79 citations
- Battling the Non-stationarity in Time Series Forecasting via Test-time AdaptationHyunGi Kim, Siwon Kim, Jisoo Mok, Sungroh YoonAAAI 2025 · 20 citations
- Dynamic Multi-period Experts for Online Time Series ForecastingSeungha Hong, Sukang Chae, Suyeon Kim, Sanghwan Jang et al.WWW 2026
- DoubleAdapt: A Meta-learning Approach to Incremental Learning for Stock Trend ForecastingLifan Zhao, Shuming Kong, Yanyan ShenKDD 2023 · 31 citations
- Performative Time-Series ForecastingZhiyuan Zhao, Haoxin Liu, Alexander Rodríguez, B. Aditya PrakashKDD 2025
