Imagining Vision From Language for Few-Shot Class-Incremental Learning
Shuo Li, Xingchen Liu, Fang Liu, Licheng Jiao, Jiahao Wang, Xinyan Huang, Yanbiao Ma, Puhua Chen, Lingling Li, Xu Liu, Xuejian Gou
摘要
Few-Shot Class-Incremental Learning (FSCIL) aims to enable the model to continuously learn new categories with only limited samples and maintain the recognition ability of old categories. However, this task faces two core challenges: catastrophic forgetting and overfitting due to data scarcity. Existing methods mostly rely on fine-tuning strategies or the transfer ability of visual language models, which is difficult to fundamentally solve the problem of insufficient image samples. To this end, we propose an incremental learning method called Imagining Vision From Language (IVFL), which consists of a base session and multiple incremental sessions. In the base session, the model generates imagined visual features through language descriptions, learns the mapping relationship from language to vision, and estimates the feature distribution of each category; in the incremental session, the model jointly uses old-class pseudo-image features, new-class images, and language descriptions to guide the model to perform effective category expansion while maintaining old-class knowledge. Our IVFL achieves an effective balance between new and old knowledge and achieves significant performance improvements on miniImageNet, CIFAR100, and CUB200 datasets, verifying its superiority in scenarios with data scarcity and knowledge retention.
问问这篇 Paper
问问你的智能体。
Lune 读过与它相关的顶会 Paper,每个回答都会注明依据哪几篇。
引用它的顶会 Paper1
问问它们各自怎么用它相关 Paper
- Few-Shot Class-Incremental Learning via Class-Aware Bilateral DistillationLinglan Zhao, Jing Lu, Yunlu Xu, Zhanzhan Cheng 等CVPR 2023
- Pre-trained Vision and Language Transformers are Few-Shot Incremental LearnersKeon-Hee Park, Kyungwoo Song, Gyeong-Moon ParkCVPR 2024 · 被引用 27 次
- Overcoming Catastrophic Forgetting in Incremental Few-Shot Learning by Finding Flat MinimaGuangyuan Shi, Jiaxin Chen, Wenlong Zhang, Li-Ming Zhan 等NeurIPS 2021 · 被引用 229 次
- Enhancing Few-Shot Class-Incremental Learning via Training-Free Bi-Level Modality CalibrationYiyang Chen, Tianyu Ding, Lei Wang, Jing Huo 等CVPR 2025
- Semantics-Driven Generative Replay for Few-Shot Class Incremental LearningAishwarya Agarwal, Biplab Banerjee, Fabio Cuzzolin, Subhasis ChaudhuriACM MM 2022 · 被引用 26 次
