Enhancing Few-Shot Class-Incremental Learning via Training-Free Bi-Level Modality Calibration
Yiyang Chen, Tianyu Ding, Lei Wang, Jing Huo, Yang Gao, Wenbin Li
摘要
Few-shot Class-Incremental Learning (FSCIL) challenges models to adapt to new classes with limited samples, presenting greater difficulties than traditional classincremental learning. While existing approaches rely heavily on visual models and require additional training during base or incremental phases, we propose a training-free framework that leverages pre-trained visual-language models like CLIP. At the core of our approach is a novel Bilevel Modality Calibration (BiMC) strategy. Our framework initially performs intra-modal calibration, combining LLM-generated fine-grained category descriptions with visual prototypes from the base session to achieve precise classifier estimation. This is further complemented by inter-modal calibration that fuses pre-trained linguistic knowledge with task-specific visual priors to mitigate modality-specific biases. To enhance prediction robustness, we introduce additional metrics and strategies that maximize the utilization of limited data. Extensive experimental results demonstrate that our approach significantly outperforms existing methods. Code is available at: https://github.com/yychen016/BiMC .
问问这篇 Paper
智能体会读完全文。
Lune 把这篇 Paper 索引到了每一个公式,引用它的顶会 Paper 也一样。你提问,回答直接引用原文。
引用它的顶会 Paper3
- Few-Shot Incremental 3D Object Detection in Dynamic Indoor EnvironmentsYun Zhu, Jianjun Qian, Jian Yang, Jin Xie 等CVPR 2026 · 被引用 2 次
- Semantic-Guided Global-Local Collaborative Prompt Learning for Few-Shot Class Incremental Learningyongxin yan, Weisen Chen, Xingye Chen, Yuanjie Shao 等CVPR 2026
- Quantized Residuals to Continuous Prompts for Few-Shot Class Incremental Learning in Vision-Language ModelsAbhishek Kumar Sinha, Nitant Dube, Soma BiswasCVPR 2026
它引用的顶会 Paper35
- Learning Transferable Visual Models From Natural Language SupervisionAlec Radford, Jong Wook Kim, Chris Hallacy, Aditya Ramesh 等ICML 2021 · 被引用 47,906 次
- Conditional Prompt Learning for Vision-Language ModelsKaiyang Zhou, Jingkang Yang, Chen Change Loy, Ziwei LiuCVPR 2022 · 被引用 1,438 次
- Mind the Gap: Understanding the Modality Gap in Multi-modal Contrastive Representation LearningWeixin Liang, Yuhui Zhang, Yongchan Kwon, Serena Yeung 等NeurIPS 2022 · 被引用 834 次
- Learning to Prompt for Continual LearningZifeng Wang, Zizhao Zhang, Chen-Yu Lee, Han Zhang 等CVPR 2022 · 被引用 635 次
- Self-regulating Prompts: Foundational Model Adaptation without ForgettingMuhammad Uzair Khattak, Syed Talal Wasim, Muzammal Naseer, Salman Khan 等ICCV 2023 · 被引用 365 次
相关 Paper
- Probabilistic Prototype Calibration of Vision-Language Models for Generalized Few-Shot Semantic SegmentationJie Liu, Jiayi Shen, Pan Zhou, Jan-Jakob Sonke 等ICCV 2025 · 被引用 4 次
- Feature Decomposition-Recomposition in Large Vision-Language Model for Few-Shot Class-Incremental LearningZongyao Xue, Meina Kan, Shiguang Shan, Xilin ChenICCV 2025 · 被引用 1 次
- HyCal: A Training-Free Prototype Calibration Method for Cross-Discipline Few-Shot Class-Incremental LearningEunju Lee, MiHyeon Kim, JuneHyoung Kwon, Yoonji Lee 等CVPR 2026 · 被引用 1 次
- Imagining Vision From Language for Few-Shot Class-Incremental LearningShuo Li, Xingchen Liu, Fang Liu, Licheng Jiao 等ACM MM 2025 · 被引用 2 次
- Multimodality Helps Unimodality: Cross-Modal Few-Shot Learning with Multimodal ModelsZhiqiu Lin, Samuel Yu, Zhiyi Kuang, Deepak Pathak 等CVPR 2023
