Online Continual Learning on Class Incremental Blurry Task Configuration with Anytime Inference
Hyunseo Koh, Dahyun Kim, Jung-Woo Ha, Jonghyun Choi
Abstract
Despite rapid advances in continual learning, a large body of research is devoted to improving performance in the existing setups. While a handful of work do propose new continual learning setups, they still lack practicality in certain aspects. For better practicality, we first propose a novel continual learning setup that is online, task-free, class-incremental, of blurry task boundaries and subject to inference queries at any moment. We additionally propose a new metric to better measure the performance of the continual learning methods subject to inference queries at any moment. To address the challenging setup and evaluation protocol, we propose an effective method that employs a new memory management scheme and novel learning techniques. Our empirical validation demonstrates that the proposed method outperforms prior arts by large margins. Code and data splits are available at https://github.com/naver-ai/i-Blurry . * indicates equal contribution. † indicates corresponding author. This work was done while HK, DK and JC were interns and an AI technical advisor at NAVER AI Lab.
Ask about this paper
Your agent reads all of it.
Lune indexed this paper to the last equation, along with the top-tier papers that cite it. Ask a question and the answer quotes them.
Your agent calls
Luneget_paper_fulltext
Free to start. No credit card required.
Terminal
Install the CLIlune papers fulltext af4b553b-5614-4f52-816b-bd4bb90187f0Cited by top-tier papers33
- GACL: Exemplar-Free Generalized Analytic Continual LearningHuiping Zhuang, Yizhu Chen, Di Fang, Run He et al.NeurIPS 2024 · 36 citations
- Online Class Incremental Learning on Stochastic Blurry Task Boundary via Mask and Visual Prompt TuningJun-Yeong Moon, Keon-Hee Park, Jung Uk Kim, Gyeong-Moon ParkICCV 2023 · 36 citations
- Data Augmented Flatness-aware Gradient Projection for Continual LearningEnneng Yang, Li Shen, Zhenyi Wang, Shiwei Liu et al.ICCV 2023 · 28 citations
- BECoTTA: Input-dependent Online Blending of Experts for Continual Test-time AdaptationDaeun Lee, Jaehong Yoon, Sung Ju HwangICML 2024 · 27 citations
- CBA: Improving Online Continual Learning via Continual Bias AdaptorQuanziang Wang, Renzhen Wang, Yichen Wu, Xixi Jia et al.ICCV 2023 · 25 citations
Builds on10
- CutMix: Regularization Strategy to Train Strong Classifiers With Localizable FeaturesSangdoo Yun, Dongyoon Han, Sanghyuk Chun, Seong Joon Oh et al.ICCV 2019 · 5,843 citations
- Gradient Projection Memory for Continual LearningGobinda Saha, Isha Garg, Kaushik RoyICLR 2021 · 409 citations
- Understanding the Role of Training Regimes in Continual LearningSeyed-Iman Mirzadeh, Mehrdad Farajtabar, Razvan Pascanu, Hassan GhasemzadehNeurIPS 2020 · 295 citations
- A Neural Dirichlet Process Mixture Model for Task-Free Continual LearningSoochan Lee, Junsoo Ha, Dongsu Zhang, Gunhee KimICLR 2020 · 238 citations
- Uncertainty-guided Continual Learning with Bayesian Neural NetworksSayna Ebrahimi, Mohamed Elhoseiny, Trevor Darrell, Marcus RohrbachICLR 2020 · 211 citations
Related papers
- Online Boundary-Free Continual Learning by Scheduled Data PriorHyunseo Koh, Minhyuk Seo, Jihwan Bang, Hwanjun Song et al.ICLR 2023
- Rainbow Memory: Continual Learning With a Memory of Diverse SamplesJihwan Bang, Heesu Kim, Youngjoon Yoo, Jung-Woo Ha et al.CVPR 2021
- Adaptive Retention & Correction: Test-Time Training for Continual LearningHaoran Chen, Micah Goldblum, Zuxuan Wu, Yu-Gang JiangICLR 2025
- Online Task-Free Continual Generative and Discriminative Learning via Dynamic Cluster MemoryFei Ye, Adrian G. BorsCVPR 2024
- Online Task-Free Continual Learning via Dynamic Expansionable Memory DistributionFei Ye, Adrian G. BorsCVPR 2025
