Instance Credibility Inference for Few-Shot Learning
Yikai Wang, Chengming Xu, Chen Liu, Li Zhang, Yanwei Fu
Abstract
Few-shot learning (FSL) aims to recognize new objects with extremely limited training data for each category. Previous efforts are made by either leveraging meta-learning paradigm or novel principles in data augmentation to alleviate this extremely data-scarce problem. In contrast, this paper presents a simple statistical approach, dubbed Instance Credibility Inference (ICI) to exploit the distribution support of unlabeled instances for few-shot learning. Specifically, we first train a linear classifier with the labeled few-shot examples and use it to infer the pseudolabels for the unlabeled data. To measure the credibility of each pseudo-labeled instance, we then propose to solve another linear regression hypothesis by increasing the sparsity of the incidental parameters and rank the pseudo-labeled instances with their sparsity degree. We select the most trustworthy pseudo-labeled instances alongside the labeled examples to re-train the linear classifier. This process is iterated until all the unlabeled samples are included in the expanded training set, i.e. the pseudo-label is converged for unlabeled data pool. Extensive experiments under two fewshot settings show that our simple approach can establish new state-of-the-arts on four widely used few-shot learning benchmark datasets including miniImageNet, tieredIm-ageNet, CIFAR-FS, and CUB.
Ask about this paper
Your agent reads all of it.
Lune indexed this paper to the last equation, along with the top-tier papers that cite it. Ask a question and the answer quotes them.
Your agent calls
Luneget_paper_fulltext
Free to start. No credit card required.
Terminal
Install the CLIlune papers fulltext 80294d01-ecbc-448d-a8f6-d2b15991ab72Cited by top-tier papers32
- Joint Distribution Matters: Deep Brownian Distance Covariance for Few-Shot ClassificationJiangtao Xie, Fei Long, Jiaming Lv, Qilong Wang et al.CVPR 2022 · 270 citations
- Self-training For Few-shot Transfer Across Extreme Task DifferencesCheng Perng Phoo, Bharath HariharanICLR 2021 · 131 citations
- ReAcTable: Enhancing ReAct for Table Question AnsweringYunjia Zhang, Jordan Henkel, Avrilia Floratou, Joyce Cahoon et al.VLDB 2024 · 120 citations
- Binocular Mutual Learning for Improving Few-shot ClassificationZiqi Zhou, Xi Qiu, Jiangtao Xie, Jianan Wu et al.ICCV 2021 · 101 citations
- Depth Guided Adaptive Meta-Fusion Network for Few-shot Video RecognitionYuqian Fu, Li Zhang, Junke Wang, Yanwei Fu et al.ACM MM 2020 · 97 citations
Builds on2
Related papers
- Iterative label cleaning for transductive and semi-supervised few-shot learningMichalis Lazarou, Tania Stathaki, Yannis AvrithisICCV 2021 · 82 citations
- Semi-Supervised Few-shot Learning via Multi-Factor ClusteringJie Ling, Lei Liao, Meng Yang, Jia ShuaiCVPR 2022 · 23 citations
- An Embarrassingly Simple Approach to Semi-Supervised Few-Shot LearningXiu-Shen Wei, He-Yang Xu, Faen Zhang, Yuxin Peng et al.NeurIPS 2022 · 24 citations
- Pseudo-loss Confidence Metric for Semi-supervised Few-shot LearningKai Huang, Jie Geng, Wen Jiang, Xinyang Deng et al.ICCV 2021 · 52 citations
- Pseudo Informative Episode Construction for Few-Shot Class-Incremental LearningChaofan Chen, Xiaoshan Yang, Changsheng XuAAAI 2025 · 6 citations
