Generalized Incremental Learning under Concept Drift across Evolving Data Streams
En Yu, Jie Lu, Guangquan Zhang
Abstract
Real-world data streams exhibit inherent non-stationarity characterized by concept drift, posing significant challenges for adaptive learning systems. While existing methods address isolated distribution shifts, they overlook the critical co-evolution of label spaces and distributions under limited supervision and persistent uncertainty. To address this, we formalize Generalized Incremental Learning under Concept Drift (GILCD), characterizing the joint evolution of distributions and label spaces in open-environment streaming contexts, and propose a novel framework called Calibrated Source-Free Adaptation (CSFA). First, CSFA introduces a training-free prototype calibration mechanism that dynamically fuses emerging prototypes with base representations, enabling stable new-class identification without optimization overhead. Second, we design a novel source-free adaptation algorithm, i.e., Reliable Surrogate Gap Sharpness-aware (RSGS) minimization. It integrates sharpness-aware perturbation loss optimization with surrogate gap minimization, while employing entropy-based uncertainty filtering to discard unreliable samples. This mechanism ensures robust distribution alignment and mitigates generalization degradation caused by uncertainties. Thus, CSFA establishes a unified framework for stable adaptation to evolving semantics and distributions in open-world streaming scenarios. Extensive experiments validate the superior performance and effectiveness of CSFA compared to SOTA approaches.
Ask about this paper
Your agent reads all of it.
Lune indexed this paper to the last equation, along with the top-tier papers that cite it. Ask a question and the answer quotes them.
Your agent calls
Luneget_paper_fulltext
Free to start. No credit card required.
Terminal
Install the CLIlune papers fulltext c40d7d93-2ab3-41a4-aa9a-27ca75237cc6Cited by top-tier papers2
- Respecting Modality Gap in Post-hoc Out-of-distribution Detection with Pre-trained Vision-Language ModelsYuanwei Hu, Bo Peng, Yadan Luo, zhen fang et al.ICML 2026
- A Close Look at Negative Label Guided Out-of-distribution Detection in Pre-trained Vision-Language ModelsBo Peng, Jie Lu, zhen fang, Guangquan ZhangICML 2026
Builds on25
- Sharpness-aware Minimization for Efficiently Improving GeneralizationPierre Foret, Ariel Kleiner, Hossein Mobahi, Behnam NeyshaburICLR 2021 · 1,861 citations
- Tent: Fully Test-Time Adaptation by Entropy MinimizationDequan Wang, Evan Shelhamer, Shaoteng Liu, Bruno A. Olshausen et al.ICLR 2021 · 1,731 citations
- Do We Really Need to Access the Source Data? Source Hypothesis Transfer for Unsupervised Domain AdaptationJian Liang, Dapeng Hu, Jiashi FengICML 2020 · 1,624 citations
- Test-Time Training with Self-Supervision for Generalization under Distribution ShiftsYu Sun, Xiaolong Wang, Zhuang Liu, John Miller et al.ICML 2020 · 1,220 citations
- Learning to Prompt for Continual LearningZifeng Wang, Zizhao Zhang, Chen-Yu Lee, Han Zhang et al.CVPR 2022 · 635 citations
Related papers
- Continual Segmentation under Joint NonstationarityPrashant Pandey, Himanshu Kumar, Devineni Chowdary, Brejesh LallICML 2026
- DriftSurf: Stable-State / Reactive-State Learning under Concept DriftAshraf Tahmasbi, Ellango Jothimurugesan, Srikanta Tirthapura, Phillip B. GibbonsICML 2021 · 44 citations
- RC-FCL: Combating Asynchronous Concept Drift in Federated Continual Learning via Retrospective CalibrationHang Su, Yijun Mo, Zhiyu Zhang, Yankai Jiang et al.ICML 2026
- Test-time Adaptation in Non-stationary Environments via Adaptive Representation AlignmentZhen-Yu Zhang, Zhiyu Xie, Huaxiu Yao, Masashi SugiyamaNeurIPS 2024 · 12 citations
- Beyond the Static World: Continual Category Discovery under Visual DriftWei Feng, Yiwen Jiang, Sijin Zhou, Zongyuan GeCVPR 2026 · 2 citations
