Pseudo-loss Confidence Metric for Semi-supervised Few-shot Learning
Kai Huang, Jie Geng, Wen Jiang, Xinyang Deng, Zhe Xu
Abstract
Semi-supervised few-shot learning is developed to train a classifier that can adapt to new tasks with limited labeled data and a fixed quantity of unlabeled data. Most semi-supervised few-shot learning methods select pseudo-labeled data of unlabeled set by task-specific confidence estimation. This work presents a task-unified confidence estimation approach for semi-supervised few-shot learning, named pseudo-loss confidence metric (PLCM). It measures the data credibility by the loss distribution of pseudo-labels, which is synthetical considered multi-tasks. Specifically, pseudo-labeled data of different tasks are mapped to a unified metric space by mean of the pseudo-loss model, making it possible to learn the prior pseudo-loss distribution. Then, confidence of pseudo-labeled data is estimated according to the distribution component confidence of its pseudo-loss. Thus highly reliable pseudo-labeled data are selected to strengthen the classifier. Moreover, to overcome the pseudo-loss distribution shift and improve the effectiveness of classifier, we advance the multi-step training strategy coordinated with the class balance measures of class-apart selection and class weight. Experimental results on four popular benchmark datasets demonstrate that the proposed approach can effectively select pseudo-labeled data and achieve the state-of-the-art performance.
Ask about this paper
Your agent reads all of it.
Lune indexed this paper to the last equation, along with the top-tier papers that cite it. Ask a question and the answer quotes them.
Your agent calls
Luneget_paper_fulltext
Free to start. No credit card required.
Terminal
Install the CLIlune papers fulltext d4fa4437-4ad1-47e7-9fe7-55d24d2def33Cited by top-tier papers10
- Pushing the Limits of Simple Pipelines for Few-Shot Learning: External Data and Fine-Tuning Make a DifferenceShell Xu Hu, Da Li, Jan Stühmer, Minyoung Kim et al.CVPR 2022 · 161 citations
- An Embarrassingly Simple Approach to Semi-Supervised Few-Shot LearningXiu-Shen Wei, He-Yang Xu, Faen Zhang, Yuxin Peng et al.NeurIPS 2022 · 24 citations
- Deep Insights into Noisy Pseudo Labeling on Graph DataBotao Wang, Jia Li, Yang Liu, Jiashun Cheng et al.NeurIPS 2023 · 24 citations
- Semi-Supervised Few-shot Learning via Multi-Factor ClusteringJie Ling, Lei Liao, Meng Yang, Jia ShuaiCVPR 2022 · 23 citations
- Prototypical Kernel Learning and Open-set Foreground Perception for Generalized Few-shot Semantic SegmentationKai Huang, Feigege Wang, Ye Xi, Yutao GaoICCV 2023 · 16 citations
Builds on9
- FixMatch: Simplifying Semi-Supervised Learning with Consistency and ConfidenceKihyuk Sohn, David Berthelot, Nicholas Carlini, Zizhao Zhang et al.NeurIPS 2020 · 5,129 citations
- DivideMix: Learning with Noisy Labels as Semi-supervised LearningJunnan Li, Richard Socher, Steven C. H. HoiICLR 2020 · 1,326 citations
- Transductive Episodic-Wise Adaptive Metric for Few-Shot LearningLimeng Qiao, Yemin Shi, Jia Li, Yonghong Tian et al.ICCV 2019 · 196 citations
- Empirical Bayes Transductive Meta-Learning with Synthetic GradientsShell Xu Hu, Pablo Garcia Moreno, Yang Xiao, Xi Shen et al.ICLR 2020 · 139 citations
- TransMatch: A Transfer-Learning Scheme for Semi-Supervised Few-Shot LearningZhongjie Yu, Lin Chen, Zhongwei Cheng, Jiebo LuoCVPR 2020
Related papers
- Instance Credibility Inference for Few-Shot LearningYikai Wang, Chengming Xu, Chen Liu, Li Zhang et al.CVPR 2020
- Iterative label cleaning for transductive and semi-supervised few-shot learningMichalis Lazarou, Tania Stathaki, Yannis AvrithisICCV 2021 · 82 citations
- Boosting Few-Shot Learning With Adaptive Margin LossAoxue Li, Weiran Huang, Xu Lan, Jiashi Feng et al.CVPR 2020
- Multidimensional Belief Quantification for Label-Efficient Meta-LearningDeep Shankar Pandey, Qi YuCVPR 2022 · 8 citations
- PLATINUM: Semi-Supervised Model Agnostic Meta-Learning using Submodular Mutual InformationChangbin Li, Suraj Kothawade, Feng Chen, Rishabh K. IyerICML 2022 · 6 citations
