DDG-DA: Data Distribution Generation for Predictable Concept Drift Adaptation
Wendi Li, Xiao Yang, Weiqing Liu, Yingce Xia, Jiang Bian
Abstract
In many real-world scenarios, we often deal with streaming data that is sequentially collected over time. Due to the non-stationary nature of the environment, the streaming data distribution may change in unpredictable ways, which is known as the concept drift in the literature. To handle concept drift, previous methods first detect when/where the concept drift happens and then adapt models to fit the distribution of the latest data. However, there are still many cases that some underlying factors of environment evolution are predictable, making it possible to model the future concept drift trend of the streaming data, while such cases are not fully explored in previous work. In this paper, we propose a novel method DDG-DA, that can effectively forecast the evolution of data distribution and improve the performance of models. Specifically, we first train a predictor to estimate the future data distribution, then leverage it to generate training samples, and finally train models on the generated data. We conduct experiments on three real-world tasks (forecasting on stock price trend, electricity load and solar irradiance) and obtained significant improvement on multiple widely-used models.
Ask about this paper
Your agent reads all of it.
Lune indexed this paper to the last equation, along with the top-tier papers that cite it. Ask a question and the answer quotes them.
Your agent calls
Luneget_paper_fulltext
Free to start. No credit card required.
Terminal
Install the CLIlune papers fulltext f2336c10-ed31-474d-984e-e04871411e38Cited by top-tier papers27
- Adaptive Normalization for Non-stationary Time Series Forecasting: A Temporal Slice PerspectiveZhiding Liu, Mingyue Cheng, Zhi Li, Zhenya Huang et al.NeurIPS 2023 · 162 citations
- OneNet: Enhancing Time Series Forecasting Models under Concept Drift by Online EnsemblingYifan Zhang, Qingsong Wen, Xue Wang, Weiqi Chen et al.NeurIPS 2023 · 124 citations
- Frequency Adaptive Normalization For Non-stationary Time Series ForecastingWeiwei Ye, Songgaojun Deng, Qiaosha Zou, Ning GuiNeurIPS 2024 · 99 citations
- DDN: Dual-domain Dynamic Normalization for Non-stationary Time Series ForecastingTao Dai, Beiliang Wu, Peiyuan Liu, Naiqi Li et al.NeurIPS 2024 · 48 citations
- Online Boosting Adaptive Learning under Concept Drift for Multistream ClassificationEn Yu, Jie Lu, Bin Zhang, Guangquan ZhangAAAI 2024 · 40 citations
Related papers
- Proactive Model Adaptation Against Concept Drift for Online Time Series ForecastingLifan Zhao, Yanyan ShenKDD 2025 · 10 citations
- Learning with Feature and Distribution Evolvable StreamsZhenyu Zhang, Peng Zhao, Yuan Jiang, Zhi-Hua ZhouICML 2020 · 48 citations
- DriftSurf: Stable-State / Reactive-State Learning under Concept DriftAshraf Tahmasbi, Ellango Jothimurugesan, Srikanta Tirthapura, Phillip B. GibbonsICML 2021 · 44 citations
- DoubleAdapt: A Meta-learning Approach to Incremental Learning for Stock Trend ForecastingLifan Zhao, Shuming Kong, Yanyan ShenKDD 2023 · 31 citations
- TRACE: A Generalizable Drift Detector for Streaming Data-Driven OptimizationYuan-Ting Zhong, Ting Huang, Xiaolin Xiao, Yue-Jiao GongAAAI 2026 · 1 citation
